-- Logs begin at Thu 2022-07-07 02:36:01 UTC, end at Thu 2022-07-07 04:25:11 UTC. -- Jul 07 03:49:48.389881 dv-cinder-846842-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 07 03:49:48.400497 dv-cinder-846842-11-smb devstack@keystone.service[80350]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 7 03:49:48 2022] *** Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: nodename: dv-cinder-846842-11-smb Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: machine: x86_64 Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: clock source: unix Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: pcre jit disabled Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: detected number of CPU cores: 4 Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: current working directory: / Jul 07 03:49:48.402468 dv-cinder-846842-11-smb devstack@keystone.service[80350]: detected binary path: /usr/bin/uwsgi-core Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: your processes number limit is 47680 Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: your memory page size is 4096 bytes Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: detected max file descriptor number: 2048 Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: lock engine: pthread robust mutexes Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: thunder lock: enabled Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 07 03:49:48.403062 dv-cinder-846842-11-smb devstack@keystone.service[80350]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 07 03:49:48.445587 dv-cinder-846842-11-smb devstack@keystone.service[80350]: Python main interpreter initialized at 0x5567798869c0 Jul 07 03:49:48.445587 dv-cinder-846842-11-smb devstack@keystone.service[80350]: python threads support enabled Jul 07 03:49:48.445587 dv-cinder-846842-11-smb devstack@keystone.service[80350]: your server socket listen backlog is limited to 100 connections Jul 07 03:49:48.445587 dv-cinder-846842-11-smb devstack@keystone.service[80350]: your mercy for graceful operations on workers is 90 seconds Jul 07 03:49:48.445945 dv-cinder-846842-11-smb devstack@keystone.service[80350]: mapped 403077 bytes (393 KB) for 2 cores Jul 07 03:49:48.445945 dv-cinder-846842-11-smb devstack@keystone.service[80350]: *** Operational MODE: preforking *** Jul 07 03:49:48.446260 dv-cinder-846842-11-smb devstack@keystone.service[80350]: *** uWSGI is running in multiple interpreter mode *** Jul 07 03:49:48.446260 dv-cinder-846842-11-smb devstack@keystone.service[80350]: spawned uWSGI master process (pid: 80350) Jul 07 03:49:48.446443 dv-cinder-846842-11-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 07 03:49:48.447457 dv-cinder-846842-11-smb devstack@keystone.service[80350]: spawned uWSGI worker 1 (pid: 80362, cores: 1) Jul 07 03:49:48.447457 dv-cinder-846842-11-smb devstack@keystone.service[80350]: spawned uWSGI worker 2 (pid: 80363, cores: 1) Jul 07 03:49:48.447457 dv-cinder-846842-11-smb devstack@keystone.service[80350]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 07 03:49:53.777800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:53.777800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes Jul 07 03:49:53.778634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:53.778634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: from cryptography.utils import int_from_bytes Jul 07 03:49:53.781457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:53.781457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 07 03:49:53.781969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 07 03:49:53.781969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 07 03:49:53.827072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:49:53.827260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:49:53.827465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] command line args: [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:49:53.827726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:49:53.827857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 07 03:49:53.827939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ================================================================================ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:49:53.828011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 07 03:49:53.828157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.828303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] command line args: [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 07 03:49:53.828381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_dir = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.828466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 07 03:49:53.828540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.828622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ================================================================================ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 07 03:49:53.828795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] config_source = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.828882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] debug = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.828940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_dir = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_source = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] debug = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.829874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_config_append = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.830938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_dir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_config_append = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.831946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_dir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.832830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.833992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.834959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] publish_errors = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.835912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.836918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] standard_threads = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.26/identity {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] publish_errors = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.837902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_journal = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_json = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_stderr = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] use_syslog = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.838997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.839113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.839229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] standard_threads = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.839345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.839460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.839607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.839727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.839727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.840031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.840163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_journal = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.840287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.840746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_json = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.840746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_stderr = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.840967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_syslog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.841192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 07 03:49:53.841418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.841998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.842968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.843987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.844910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.845929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.846940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.847953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.848981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.849945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.850958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.851968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.852956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.853978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.854906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.855922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.856988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.857972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.858875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.859989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.860997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.861914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.862935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.external = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.863858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.password = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] auth.token = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.864908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.external = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.865941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.password = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.token = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.866935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.867954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868313 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.868972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869306 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.869990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.870898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.871943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.872902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.873914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.874918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.875929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.876850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.877949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.878969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.879981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.880935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.881962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.882859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.883961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.884994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.885902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.886994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.887904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.888934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.889945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.890946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.891963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.892991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.893894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.894904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.895988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.896911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.897906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.898896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.899975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.900906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.901913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.902965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.903977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.904939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.905932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.906946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.907947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.908993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.909902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.910907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.911924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:49:53.912560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 07 03:49:53.912560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 07 03:49:53.942112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.942239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.942320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.942477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.942569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.942673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.950948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.951140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.978873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.979100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.979605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:53.979836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.123472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.129405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.172818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.173014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.173510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.173742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.236439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.236659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.236871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.237933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.238175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.262939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.263709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.274363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.274989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.287867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.288695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80363) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 07 03:49:54.305467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.305644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 03:49:54.305999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 03:49:54.306336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 03:49:54.306692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.306985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 07 03:49:54.307168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.307293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.307504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.307760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.308013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.317949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.318215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.318474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.318751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.318903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.319143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.319409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.319691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.327060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.328013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.330313 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.330586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.330855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.331396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.331984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.332955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.333174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.333435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.333703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.333960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.359571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.360897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.361182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.361463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.362512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.362794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.366994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.367271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.367538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.368046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.368356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.368738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.374995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.375215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.376064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.376364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.379638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.379926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.380218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.380491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.380755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.380877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.381000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.381879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.382148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.382410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.382675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.400429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.400694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.401314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.401586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.405250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.406173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.408874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.409158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.409814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.410105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.414226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.415204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.418164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.418871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.421786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.422910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.423063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.423188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.423361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.423645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.423919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.442223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.442497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.442737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.442980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.443121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.443286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.443556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.443828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.450885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.451832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.452596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.452869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.453555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.453829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.456000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.456305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.456587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.456858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.457049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.457181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.457322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.457626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.457908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.458178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.470618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.470886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.471157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.471427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.471695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.471926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.472053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.472198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.472293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.472496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.472772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.473047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.474623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.474928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.491224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.492852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.494490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.496141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.497828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.499417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.499543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.501181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.501308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.501430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.501735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.502874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.503148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.503427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.508915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.510518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.510678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.512455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.513780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.514059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.514333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.514596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.515675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.515959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.516380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.516664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.523678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.523958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.524254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.525728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.526009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.526282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.532079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.532377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.532645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.532906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.533176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.533436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.533700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.533965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.534229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80363) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 07 03:49:54.534356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.534508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.534634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.534768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.534872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.535955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.536264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.536532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.536814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.537072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.537332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.537602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.537864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80363) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 07 03:49:54.572738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567798869c0 pid: 80362 (default app) Jul 07 03:49:54.575772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5567798869c0 pid: 80363 (default app) Jul 07 03:49:54.576097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05b99-0310-4da5-b27a-7aceaa2282b5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:49:54.576403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05b99-0310-4da5-b27a-7aceaa2282b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:49:54.576682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b05b99-0310-4da5-b27a-7aceaa2282b5 None None] PATH_INFO: `/v3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:49:54.581011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 791 bytes} [Thu Jul 7 03:49:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:02.208312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:02.209182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:02.209492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:02.218020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1/2] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:02 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:02.225516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:02.225977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:02.226092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:02.297146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: INFO dbcounter [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] Registered counter for database keystone Jul 07 03:50:02.323232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG oslo_db.sqlalchemy.engines [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:50:02.330970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writer thread running {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:50:02.514728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 07 03:50:02.514982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 07 03:50:02.570705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:02.572424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:02.710744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 07 03:50:02.926678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:02.998869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: INFO dbcounter [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] Registered counter for database keystone Jul 07 03:50:03.020552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG oslo_db.sqlalchemy.engines [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 07 03:50:03.028572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writer thread running {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 07 03:50:03.146951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684cb48-599a-403f-b887-07435b4f0d45 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:03.152529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:03.153187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:03.153463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:03.153735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:03.166151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:03.218131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 07 03:50:03.218680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b67efc-e4ed-41de-8d38-a46468d2c51b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:03.228775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jul 7 03:50:02 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 07 03:50:03.238716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:03.262189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095085-7627-4c59-906a-c821c71fc0bc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:03.268739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:03.269910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:03.270198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:03.270478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] PATH_INFO: `/v3/projects/43ba045a853249cf8b4e900b21790d5d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:03.272263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] RBAC: Authorizing `identity:get_project(project_id=43ba045a853249cf8b4e900b21790d5d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:03.325391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 07 03:50:03.325729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faac62f-2d71-4110-96e4-989b157e4a93 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:03.330386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 3/5] 10.222.0.26 () {56 vars in 1207 bytes} [Thu Jul 7 03:50:03 2022] GET /identity/v3/projects/43ba045a853249cf8b4e900b21790d5d => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:05.331120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313999a-d487-4660-af87-389c2cfc7b67 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:05.331940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313999a-d487-4660-af87-389c2cfc7b67 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:05.331940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313999a-d487-4660-af87-389c2cfc7b67 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:05.338741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 3/6] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:05.344795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:05.345215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:05.345305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:05.365701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:05.367231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:05.376152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 07 03:50:05.399439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313999a-d487-4660-af87-389c2cfc7b67 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:05.420562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313999a-d487-4660-af87-389c2cfc7b67 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:05.426052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:05.426689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:05.426973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:05.427246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:05.435259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:05.437090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13612e0-05ea-412f-84f9-c369ec0cdfab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:05.446111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1324 bytes} [Thu Jul 7 03:50:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 03:50:05.451586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:05.461689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbb0727-67ba-40cf-8a99-22f8ecd222ea None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:05.467875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:05.468820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:05.469135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:05.469410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:05.470965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:05.472898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a86357-3c6e-40b9-9e77-13ffed7f6154 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:05.474487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 5/9] 10.222.0.26 () {56 vars in 1198 bytes} [Thu Jul 7 03:50:05 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:07.629810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710450e-12f9-47b9-925a-1e9140e09af7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:07.630343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710450e-12f9-47b9-925a-1e9140e09af7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:07.630445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710450e-12f9-47b9-925a-1e9140e09af7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:07.631777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 5/10] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:07.637339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999eb01-55e3-44d8-8218-1a19f6a97fdf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:07.637765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999eb01-55e3-44d8-8218-1a19f6a97fdf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:07.637856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999eb01-55e3-44d8-8218-1a19f6a97fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:07.655835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6999eb01-55e3-44d8-8218-1a19f6a97fdf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:07.657089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6999eb01-55e3-44d8-8218-1a19f6a97fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:07.740784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:07.763008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710450e-12f9-47b9-925a-1e9140e09af7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:07.913865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710450e-12f9-47b9-925a-1e9140e09af7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:07.936939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d60c-ef5d-4d4c-93ab-eac700a49919 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:07.937320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d60c-ef5d-4d4c-93ab-eac700a49919 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:07.937562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e841d60c-ef5d-4d4c-93ab-eac700a49919 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:07.938922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 7/12] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:07.944710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:07.944996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:07.945275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:07.948857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:07.949516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:07.949790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:07.950057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:07.962870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:07.964109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:07.982546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:07.993760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:08.021987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.023500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.038610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:08.062258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.124827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 6/14] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:08.130497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.166260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11062f9c-780d-456f-b1f7-62b142ee1440 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.200474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.201289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.201569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.201842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.204690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:08.213955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:08.225665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:08.226590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:08.227417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 9/15] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:08.231642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43862947-6b5d-4b43-9d87-58c65d401367 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.234124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.249705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:08.266473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.267286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.267565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.267866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.286670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.288191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:50:08.308971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:08.309868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:08.311017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:50:08.311017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:50:08.311017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:50:08.311017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:08.311017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 7/16] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:08.316096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.341977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c4ed0e-2b2d-4cf6-bc16-ae2b987c88db None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.385733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.386498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.386770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.387038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.387785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:08.388083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.389512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.402003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 10/17] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:08.407367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.414104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1ad88-54f3-4e7a-a186-ec380f5fe020 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.439855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:08.448381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.449117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.449395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.449672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.450424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:08.450737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.452156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.471014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 8/18] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:08.483283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:08.510537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6f9b-0ce2-41a6-8bea-dc6f082cca85 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.549083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.549985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.550260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.550529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.551998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.553536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.555196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 11/19] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:08.560998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.683432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e29da-ee1d-4f1c-9f19-ce30bb0f6d68 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.722188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.722923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.723206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.723476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.725022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.726490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadee536-7230-4da6-9de4-e3f09074cc4a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.728376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 9/20] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:08.733960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:08.843018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc98f9-db13-4767-96ee-1752accccbcf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:08.878635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:08.879591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:08.880002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:08.880467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:08.881468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.domain.id=default, user.id=d1bd7595a3f7469e9385fd3e6286b86e) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:08.881906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:08.883494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e065fd5-6806-4760-966c-948d989f5651 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:08.891502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 12/21] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jul 7 03:50:08 2022] GET /identity/v3/role_assignments?user.id=d1bd7595a3f7469e9385fd3e6286b86e&scope.domain.id=default&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:10.971242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298792-d606-4bc5-8e06-16253bd584e7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:10.972206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298792-d606-4bc5-8e06-16253bd584e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:10.972677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17298792-d606-4bc5-8e06-16253bd584e7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:10.974559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 10/22] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:10.984271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:10.985383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:10.985847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.004307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:11.012430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:11.013874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:11.021343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e3580-e7b9-4534-b72f-ba70e8ec2ebc None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.021867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e3580-e7b9-4534-b72f-ba70e8ec2ebc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.022340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e3580-e7b9-4534-b72f-ba70e8ec2ebc None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.023887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 11/23] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:11.030547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.031106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.031560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.054348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80363) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 07 03:50:11.056292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG passlib.handlers.bcrypt [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80363) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 07 03:50:11.153358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:11.156227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:11.171774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:11.209292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:11.299331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:11.353803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:11.389710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:11.398983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec5b89-b491-47c1-888e-806eddcdc9b5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:11.455814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:11.456641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.456926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.457203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.458062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:11.459647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e10328-9156-43b9-ab6c-faa27e4cc850 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:11.464845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:11.522962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775522a2-ce14-4fd0-ae08-8c29532369b2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:11.558173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:11.559582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.560020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.560495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.573921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:11.575806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bd0e028b-a3d2-488f-a191-292f01d7d47a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:50:11.594830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:11.595766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:11.596691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:50:11.596691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:50:11.596691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:50:11.596691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:11.596886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 14/26] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jul 7 03:50:11 2022] POST /identity/v3/roles => generated 219 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:11.596968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb3eab-94de-4528-bef8-3dec077db6c7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.597296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb3eab-94de-4528-bef8-3dec077db6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.597579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb3eab-94de-4528-bef8-3dec077db6c7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.598995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 15/27] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:11.603244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87358-2c36-487b-a6bd-b09bef4d160a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.603244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87358-2c36-487b-a6bd-b09bef4d160a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.603244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf87358-2c36-487b-a6bd-b09bef4d160a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.603244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 16/28] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:11.604403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 13/29] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:11.609697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.609697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.609886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.612263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.612880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.613377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.647139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:11.649784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:11.657739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:11.661318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:11.732689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:11.778932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 17/30] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:11.779929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:11.791435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 14/31] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:11.815079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:11.892245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c05c5b-0680-4493-8649-ed7c179fa5b6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:11.919748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:11.927302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7bea58-bb9c-4edc-aaba-bc90220b62b6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:11.933013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:11.933787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.934079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.934352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.935113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:11.935423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:11.938041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:11.959208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 18/32] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:11.960172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:11.969934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:11.970767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:11.971526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:11.972035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:11.988188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:12.003425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:12.004516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:12.005462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:12.007467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 15/33] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:12.009021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.043411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.082107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264c33-1f0f-4970-b41b-042e93249b09 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.118159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.118850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.119137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.119408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.120212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.122185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.136160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51ea20-a82c-4c4f-804b-9e6d71b98754 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.144273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 19/34] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jul 7 03:50:11 2022] POST /identity/v3/roles => generated 225 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:12.145378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.199790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.200928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.201707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.202183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.202281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.203246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.204829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bb1ab-33e3-4853-a446-83d35ef1ae52 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.263631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd74f2b-7caf-4618-b8fe-7c96af6d1f32 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.299958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.301053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.301468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.301874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.302786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:12.303227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.304826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81279fc5-cfe4-4172-ba42-ffa4117c0621 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.315025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 20/35] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:12.316695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdf06-6e28-4f06-a7cb-fd93e9321224 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.317141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdf06-6e28-4f06-a7cb-fd93e9321224 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.317548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cdf06-6e28-4f06-a7cb-fd93e9321224 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.318980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 21/36] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:12.324681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cdf06-6e28-4f06-a7cb-fd93e9321224 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.382048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 16/37] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:50:12 2022] POST /identity/v3/projects => generated 301 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:12.383727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.384021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.384324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.406771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:12.407926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:12.473714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cdf06-6e28-4f06-a7cb-fd93e9321224 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.489500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.500156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 17/38] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:12.521495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.522779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.523274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.523749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.525738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.525960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.527782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.531194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 22/39] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:12 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:12.539203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.541521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.664847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fda4e8-fa41-4a0c-a76b-f3b1e6806e70 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.704951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db408-8939-4d33-b039-60be1f407880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.705707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db408-8939-4d33-b039-60be1f407880 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.706008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db408-8939-4d33-b039-60be1f407880 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.706696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db408-8939-4d33-b039-60be1f407880 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.707518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db408-8939-4d33-b039-60be1f407880 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.709503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db408-8939-4d33-b039-60be1f407880 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.727353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 18/40] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jul 7 03:50:12 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:50:12.729168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b252b4-3d08-478c-8676-12b69c22806f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.729462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b252b4-3d08-478c-8676-12b69c22806f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.729751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b252b4-3d08-478c-8676-12b69c22806f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.731528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 19/41] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:12.737640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.737995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.738272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.759399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:12.760677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:12.783649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5b281-f613-4b97-96de-70cf544044fd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.827820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:12.828668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:12.828944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:12.829245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:12.830478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:12.831968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:12.833903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 23/42] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:12.839531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.842157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.860582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 20/43] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:12.877320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:12.896598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:12.965835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd0f4e-77ca-43b9-bfb2-4432fcab9a4d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:12.993021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c026fb-e247-4e2f-a903-e1ef5f48d326 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:13.003163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:13.004195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:13.004474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:13.004748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] PATH_INFO: `/v3/domains/default/users/d1bd7595a3f7469e9385fd3e6286b86e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:13.006846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d1bd7595a3f7469e9385fd3e6286b86e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:13.008695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:13.025420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 24/44] 10.222.0.26 () {58 vars in 1361 bytes} [Thu Jul 7 03:50:12 2022] PUT /identity/v3/domains/default/users/d1bd7595a3f7469e9385fd3e6286b86e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 03:50:13.031481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:13.032786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:13.033068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:13.033347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:13.034907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:13.036664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f847-46ff-4c9c-97c7-465543492bf0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:13.039619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 21/45] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:13.046308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:13.166954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7c562-493b-443a-a0d6-118c9ab7ac02 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:13.169489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:13.207181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:13.207864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:13.208163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:13.208451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:13.209177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:13.210667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508dfae-2c0e-4fed-9614-863d7387b9bf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:13.240090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 25/46] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:50:13 2022] POST /identity/v3/projects => generated 312 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:15.027798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b6bd-71dc-4e06-8482-b14307e9cf9b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.028390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b6bd-71dc-4e06-8482-b14307e9cf9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.028390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1b6bd-71dc-4e06-8482-b14307e9cf9b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.029757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 22/47] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:15.035446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7d12-4dfc-4c71-ac43-4268c09c70b2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.035842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7d12-4dfc-4c71-ac43-4268c09c70b2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.036034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be7d12-4dfc-4c71-ac43-4268c09c70b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.054419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-12be7d12-4dfc-4c71-ac43-4268c09c70b2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:15.055631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-12be7d12-4dfc-4c71-ac43-4268c09c70b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:15.127280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 26/48] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:15.150493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1b6bd-71dc-4e06-8482-b14307e9cf9b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.222963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.249011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8954-a57c-4b6f-bc5c-f3285c96ad49 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.249329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8954-a57c-4b6f-bc5c-f3285c96ad49 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.249630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf8954-a57c-4b6f-bc5c-f3285c96ad49 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.251040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 27/49] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:15.257834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.258116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.258389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.268332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1b6bd-71dc-4e06-8482-b14307e9cf9b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.275888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:15.277177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:15.304229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.305219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.305496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.305767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.316697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:15.324300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:15.325203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:15.326114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 23/50] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:15.331303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.343291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 28/51] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:15.365893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.382510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.431675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25fc4-3292-4df3-952f-ff8e603ab7ab None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.457197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.464430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47febe28-ce9b-454a-a78c-030a2c012ecf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.466436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.467134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.467419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.467695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.468496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:15.468896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.470313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.482767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 24/52] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:15.488239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.497692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.498501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.498782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.499057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.500284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.501771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.503570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 29/53] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:15.508758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.585665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e5b2-137c-42f8-a945-aab70be9cf84 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.591222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.607593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8481f-64a8-4ba1-b4c1-a19c5ac9429e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.619141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.620136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.620434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.620763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.622216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.623703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.625443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 25/54] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:15.630933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.643612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.644424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.644902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.645237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.645932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.647725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.677703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 30/55] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jul 7 03:50:15 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:50:15.696725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.746179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f214c-4a44-4e65-bc54-bae53188080b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.783613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.784468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.784758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.785032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.786289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.787772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cc096-1cf1-41db-aaec-ed1c889c91e5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.789550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 26/56] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:15.795874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:15.898642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04d196-238a-4aed-83e5-65c8d979d715 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:15.937188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:15.938181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:15.938181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:15.938396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:15.939272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.domain.id=default, user.id=d1bd7595a3f7469e9385fd3e6286b86e) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:15.939583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:15.941120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19f1ad-adcd-437b-9062-7d12bbffdc03 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:15.944247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:15.948006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 31/57] 10.222.0.26 () {56 vars in 1322 bytes} [Thu Jul 7 03:50:15 2022] GET /identity/v3/role_assignments?user.id=d1bd7595a3f7469e9385fd3e6286b86e&scope.domain.id=default&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:17.704577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77e7b-8221-433e-b37f-e37874f2cd1b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:17.705109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77e7b-8221-433e-b37f-e37874f2cd1b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:17.705109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a77e7b-8221-433e-b37f-e37874f2cd1b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:17.707300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 27/58] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:17.715507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:17.715961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:17.716044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:17.734776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:17.735971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:17.808776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 32/59] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:17.845542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a77e7b-8221-433e-b37f-e37874f2cd1b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:18.063513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a77e7b-8221-433e-b37f-e37874f2cd1b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:18.097368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:18.112188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:18.112993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:18.113273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:18.113545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:18.114800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:18.116436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b71b97-4939-4909-8702-194e0aa183ff None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:18.118167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 28/60] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:18.127889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:18.231230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd955-3aa7-4328-9fb8-3373add7d0f1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:18.263805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:18.270801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:18.271473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:18.271756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:18.272028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:18.272767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:18.274238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06dde8-ddf2-4a93-a377-c6ebfde615fe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:18.300863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 33/61] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:18 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:21.539924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810050f3-a367-499a-b72a-b7540c4be91d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.541007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810050f3-a367-499a-b72a-b7540c4be91d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.541482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810050f3-a367-499a-b72a-b7540c4be91d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.543089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 29/62] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:21.548360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7296b7-01ef-43f8-b67a-4e6fbcd40f25 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.549152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7296b7-01ef-43f8-b67a-4e6fbcd40f25 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.549647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7296b7-01ef-43f8-b67a-4e6fbcd40f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.573148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6d7296b7-01ef-43f8-b67a-4e6fbcd40f25 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:21.574733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6d7296b7-01ef-43f8-b67a-4e6fbcd40f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:21.667209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 34/63] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:21.667699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c511ad-0c0f-40db-87ab-4ed3cc51a7e2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.668297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c511ad-0c0f-40db-87ab-4ed3cc51a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.668761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c511ad-0c0f-40db-87ab-4ed3cc51a7e2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.670317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 30/64] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:21.675487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7010-c665-4b63-a341-f451192c4893 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.675978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7010-c665-4b63-a341-f451192c4893 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.676492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c7010-c665-4b63-a341-f451192c4893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.680511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3d7a-ade4-4115-a6ef-15f5a1215760 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.681014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3d7a-ade4-4115-a6ef-15f5a1215760 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.681535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b3d7a-ade4-4115-a6ef-15f5a1215760 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.683360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 31/65] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:21.692318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.692867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.693324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.697178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-760c7010-c665-4b63-a341-f451192c4893 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:21.698583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-760c7010-c665-4b63-a341-f451192c4893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:21.715993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:21.717684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:21.787570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 35/66] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:21.788880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c7010-c665-4b63-a341-f451192c4893 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:21.813651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:21.822085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:21.855074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:21.913390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c7010-c665-4b63-a341-f451192c4893 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:21.948867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453796-835d-4513-86a9-9f59344c72a6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:21.956649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:21.957536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.957819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.958119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.968770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:21.972044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:21.976691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:21.977773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:21.978571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 36/68] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:21.979213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:21.986807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:21.987627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:21.987904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:21.988202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:21.998029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3ad599e8-66d5-4fd9-a4d0-224788f033d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:22.006024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:22.007075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 33/69] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:22.013063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a285-aafb-4cea-aef1-a222dc835415 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a285-aafb-4cea-aef1-a222dc835415 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252a285-aafb-4cea-aef1-a222dc835415 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 34/70] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1c30-51d5-4d48-a7b9-7582afdf08e4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1c30-51d5-4d48-a7b9-7582afdf08e4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1c30-51d5-4d48-a7b9-7582afdf08e4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.014032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 35/71] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:22.014695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1c30-51d5-4d48-a7b9-7582afdf08e4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.080459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a26788-89aa-4b7e-a9f0-62f6e6bed161 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.087148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.113391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1c30-51d5-4d48-a7b9-7582afdf08e4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.117918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.118724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.119006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.119281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.130454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:22.138245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:22.139146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:22.139912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 37/72] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:22.140569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.151392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.152131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.152414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.152687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.153445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:22.153747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.155126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09157353-34ad-48cb-a5e6-36f3dd1e4543 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.163737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.164746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46a57-aca9-42c9-8c1b-84d0753c573d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.165028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46a57-aca9-42c9-8c1b-84d0753c573d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.165300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b46a57-aca9-42c9-8c1b-84d0753c573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.180477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-58b46a57-aca9-42c9-8c1b-84d0753c573d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:22.181638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-58b46a57-aca9-42c9-8c1b-84d0753c573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:22.222255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.243743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea8ee8-3ca7-4c1e-bb24-4c85b1aa936c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.248338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 37/74] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:22.249605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.249894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.250176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.266358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:22.267544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:22.282442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.283125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.283412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.283685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.284469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:22.284773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.286166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.294769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 38/75] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.294769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.327420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.334540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 38/76] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:22.335305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.399806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957ba8a-ce97-4c8b-b83e-a273ac2e5055 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.432436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.433147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.433423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.433692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.434445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:22.434743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.436140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.444383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 39/77] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.445128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a84e0c-94aa-4ddf-aa26-1cda68ceb603 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.445248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.449876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.481959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.482850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.483132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.483415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.498249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.499723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.501471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 39/78] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.504925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.530935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.540680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e5664b-59c1-4f04-a023-9a600aecc52b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.573185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.574055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.574340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.574615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.584890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:22.592895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:22.593703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:22.594516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 40/79] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:22.595136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.603935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d975a-963b-4fae-a7c2-1d3547a7d5bc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.639058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.639959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.640275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.640552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.641820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.643309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.645012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 40/80] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.645782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.674320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.696590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e231-6f61-4255-943c-a8056292f59b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.730426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.731234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.731517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.731795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.733029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.734506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.736170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 41/81] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.737016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.746183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4515f3d-b04f-48ce-8a63-842c9aeef94c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.757542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.780917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.781800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.782082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.782353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.783525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.785016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.786653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 41/82] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.787395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.836183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a33101-1204-4144-9ec8-aea1da795f73 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.869460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.870112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.870442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.870715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.884016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:22.887880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f340a9c-be77-4b78-9fb4-372cc98a4968 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:22.923009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:22.923679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:22.923966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:22.924268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:22.925013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:22.925320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.926738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.935075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 42/83] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:22.935772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:22.945203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:22.946717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:22.964645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.038669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd08c9-b103-4489-8668-88cd0ad6670b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.045783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 42/84] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:23.046751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.072374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.073134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.073423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.073694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.099987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.139717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.141292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.145895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4007e-05dd-4f52-8e6f-2878a1100df9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.162749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.180440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.181115 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.181394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.181690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.182477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.184078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.204136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 43/85] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:23 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:23.204968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.257282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 43/86] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:23.257282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.324169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.326643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba85d-fe08-4a9b-99b9-ff7db6f58433 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.371882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.372519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.372797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.373076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.379483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49aa11-f552-4600-bf77-ecb8429594ba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.424140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.425795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.426728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.427003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.427265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.428584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.430100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.438045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 44/87] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:23.438045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.460568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.463225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.557965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e22dcf-646b-4b2d-999e-36f08e93e22f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.576343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 44/88] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:23.577007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.596797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.609674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.610558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.610834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.611105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.613129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.615145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.618386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 45/89] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:23.619422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.677333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.714975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c63ca-5ef7-42e4-a65c-bcbbfb13b8e9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.737087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d2b25-b947-4468-96cc-5691cb922c4a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.761798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.762677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.762954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.763223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.764460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.766419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.772444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 45/90] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:23.772444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.788620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.789298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.789576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.789847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.863079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.874228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.876269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.905739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6b231-2d5f-4e11-b528-bc77bc93e1cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:23.949788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:23.950697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:23.950937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:23.951212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:23.952435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:23.954471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:23.955888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 46/91] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:23.961473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:23.974537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:23.993993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 46/92] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:23.995261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:24.064067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4a077-48e6-467e-ab99-cc32f93dcf2b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:24.097952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:24.106901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef633a-3e73-442c-bb84-d5812813be7e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:24.111027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:24.111886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:24.112336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:24.112775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:24.113761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:24.114212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:24.115836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:24.122028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 47/93] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:24.123022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:24.178117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:24.179151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:24.179641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:24.181885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:24.183112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:24.183604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:24.186836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:24.213854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 47/94] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:23 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:24.215030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:24.297660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:24.330419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9031eb1-efde-4bec-8edd-07643d2cbbf1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:24.396978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:24.397665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:24.398009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:24.398289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:24.399154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=d1bd7595a3f7469e9385fd3e6286b86e) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:24.399468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:24.401514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:24.420234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 48/95] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:24 2022] GET /identity/v3/role_assignments?user.id=d1bd7595a3f7469e9385fd3e6286b86e&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:24.455812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304bc19-f074-402c-9541-7774cb844baf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:24.492526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:24.493711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:24.494165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:24.494632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] PATH_INFO: `/v3/projects/56fec3706a6942efbc3b76c41cf8e257` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:24.496193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] RBAC: Authorizing `identity:get_project(project_id=56fec3706a6942efbc3b76c41cf8e257)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:24.497859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35544ce-1b66-4951-ac4e-78a9c97ba242 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:24.499796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 48/96] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:24 2022] GET /identity/v3/projects/56fec3706a6942efbc3b76c41cf8e257 => generated 312 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:24.505790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:24.614343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd443a43-8d12-4501-b587-0524939b112e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:24.651936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:24.652932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:24.653386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:24.653828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:24.654878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=56fec3706a6942efbc3b76c41cf8e257, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:24.655359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:24.657021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba482ce-5c57-492e-9b23-e074071df344 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:24.663459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 49/97] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:24 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=56fec3706a6942efbc3b76c41cf8e257&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:25.737659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf44fb-70a9-4dd7-a232-b82f20dd3e2e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:25.738653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf44fb-70a9-4dd7-a232-b82f20dd3e2e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:25.739131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf44fb-70a9-4dd7-a232-b82f20dd3e2e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:25.740741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 49/98] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:25.745985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67492-245e-4d4b-882d-af2b6eb6bcc7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:25.746742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67492-245e-4d4b-882d-af2b6eb6bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:25.747243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d67492-245e-4d4b-882d-af2b6eb6bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:25.757852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:25.777216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85d67492-245e-4d4b-882d-af2b6eb6bcc7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:25.778417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85d67492-245e-4d4b-882d-af2b6eb6bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:25.853345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 50/99] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:25.874208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0df01-d1db-4d1f-b454-200c65121855 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:25.874587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0df01-d1db-4d1f-b454-200c65121855 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:25.874885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0df01-d1db-4d1f-b454-200c65121855 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:25.876570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 50/100] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:25.882218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:25.882511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:25.882790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:25.886603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0df01-d1db-4d1f-b454-200c65121855 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:25.909181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:25.910397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:25.957127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:26.024347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 51/101] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:26.065724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:26.104833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0df01-d1db-4d1f-b454-200c65121855 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.156101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:26.171296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.172541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.173033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.173498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:26.180910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:26.182417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:26.184239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 51/102] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:26.189724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:26.201566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aaed5-f43d-463a-924e-b123f72aa50e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.251924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.254202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.254489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.254764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:26.280584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:26.294793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:26.295777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:26.296550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 52/103] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:26.303517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:26.388842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:26.402335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753e79a-fdbb-42c4-b71c-865a40885f55 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.476576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.477274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.477553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.477826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:26.478567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:26.480147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:26.515633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d4bcc-900e-4f45-8831-14fdcaf62ab7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.520842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 52/104] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:50:26 2022] POST /identity/v3/projects => generated 302 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:26.563846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:26.566421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.567136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.567427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.567745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:26.568552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:26.569168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:26.571907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:26.584349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 53/105] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:26.590777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:26.714839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ebc69-b99f-43c8-a685-17347a41c870 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.751032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.751964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.752272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.752555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] PATH_INFO: `/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:26.779936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] RBAC: Authorizing `identity:get_user(user_id=dd44fad7c54a41f79e8b8b09bbc05a38)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:26.781497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2139c962-761e-4b96-a9e9-065bbae50c06 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:26.783586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 53/106] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:26 2022] GET /identity/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38 => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:26.789297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:26.901645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd41fbdc-2b1a-4e5d-8930-7e20691cc0cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:26.947744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:26.948509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:26.948795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:26.949068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.032527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.037379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:27.038903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:27.113829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a530-f6f4-4b2a-a9a9-7d3535d40572 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.114176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a530-f6f4-4b2a-a9a9-7d3535d40572 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.114397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb3a530-f6f4-4b2a-a9a9-7d3535d40572 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.115930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 54/107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:27.125755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.125919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.126131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.145757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.152416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:27.153576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:27.173413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 54/108] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:27.179150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:27.331892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 55/109] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:27.374698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:27.383619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.400666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad0169-b38c-428a-a436-3307eeea4575 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:27.454189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:27.454986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.455269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.455536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.461331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:27.462818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99974d7b-0635-44f3-a88a-c919cb85d7cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:27.464758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 55/110] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:27 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:27.470509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a16a-53a1-4e2f-856d-8c1c3bad8c3c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.470804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a16a-53a1-4e2f-856d-8c1c3bad8c3c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.471078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3514a16a-53a1-4e2f-856d-8c1c3bad8c3c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.472591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 56/111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:27.473153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514a16a-53a1-4e2f-856d-8c1c3bad8c3c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:27.553595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf2e2-7dcf-4dd7-8d5e-b6460bf32a23 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:27.590013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:27.591244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.591550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.591792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.602541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-80878931-62ae-4266-b1cf-e3085109628c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:27.610417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:27.611286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:27.612053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 56/112] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:27.613209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e6a1-dd1c-4b97-bfbe-9adb136d7eee None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.613304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e6a1-dd1c-4b97-bfbe-9adb136d7eee None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.613552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e6a1-dd1c-4b97-bfbe-9adb136d7eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.618575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.630936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bfd7e6a1-dd1c-4b97-bfbe-9adb136d7eee None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:27.632257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bfd7e6a1-dd1c-4b97-bfbe-9adb136d7eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:27.646586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3514a16a-53a1-4e2f-856d-8c1c3bad8c3c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:27.683580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:27.684281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.684566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.684841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.685827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=dd44fad7c54a41f79e8b8b09bbc05a38) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:27.686241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:27.687702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:27.700285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 57/113] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:27 2022] GET /identity/v3/role_assignments?user.id=dd44fad7c54a41f79e8b8b09bbc05a38&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=af7440c704bf475ea053f7f233a318ad => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:27.701512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:27.703628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 57/114] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:27.705117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741d25-9706-45ff-bddc-66d75b15a058 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.705352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741d25-9706-45ff-bddc-66d75b15a058 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.705616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb741d25-9706-45ff-bddc-66d75b15a058 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.707141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 58/115] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:27.712680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7785e-698d-4223-815b-5e816eee1750 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.712964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7785e-698d-4223-815b-5e816eee1750 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.713247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7785e-698d-4223-815b-5e816eee1750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.731013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fba7785e-698d-4223-815b-5e816eee1750 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:27.732222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fba7785e-698d-4223-815b-5e816eee1750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:27.736210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.814934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 59/116] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:27.820238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283dd4-5107-4133-96b5-6755bfd1e592 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.820639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283dd4-5107-4133-96b5-6755bfd1e592 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.820924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93283dd4-5107-4133-96b5-6755bfd1e592 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.822456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 60/117] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:27.823330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93283dd4-5107-4133-96b5-6755bfd1e592 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:27.870080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf5752-1cae-4ab3-a281-f2efb05a6135 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:27.905101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:27.926737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:27.927686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.928149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.928564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.929507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:27.929944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:27.931598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be854cf-350e-4f04-b90a-9a59af5f8a21 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:27.943125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 58/118] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:27.946048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:27.946917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:27.947617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:27.965406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93283dd4-5107-4133-96b5-6755bfd1e592 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:27.971938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:27.973432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:28.011405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.012321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.012594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.013015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.027066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:28.037697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:28.038726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:28.039653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:28.047417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 61/119] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:28.047417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.055232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 59/120] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:28.056342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.067543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.170463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b53b3-eeee-476f-a122-cb0a62e109ab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.174421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d267c73-faea-4d4e-919c-5d4cbfd48064 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.197379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.218134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.219281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.219766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.220359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.223902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.224848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.225129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.225404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.226649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.228407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.230901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 60/121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.231677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.234512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:28.242909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:28.243828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:28.244626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:28.247377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 62/122] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:28.248594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.337976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.364789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639c761-a331-439d-9c0f-3b0b9d97ecdb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.367286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff5389b-e381-4590-8261-68e435c4212b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.402214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.403484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.403963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.404508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.414321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.415060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.415340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.415615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.416567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:28.416915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.417590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:28.418430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:28.426627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:28.427480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:28.429041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:28.429634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 61/123] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.429634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.431690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 63/124] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:28.432825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.472669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.550352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5051a-60f7-4ba8-bf7f-c757745584d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.553056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90283cab-609b-4890-8ede-c85fba764691 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.587152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.588238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.588519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.588631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.588871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.589297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.589647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.589922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.590440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.591092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:28.591448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.591932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.592926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.593844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 62/125] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.594530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.602569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 64/126] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.603500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.603982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.707026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620bcb5-b743-45a8-abeb-30ef4e6bd1e3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.710358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.714276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b7d0d-e364-411d-b955-c6707ac67977 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.744548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.745385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.745663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.746034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.747344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.748961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.750683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 63/127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.755709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.757371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.758068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.758349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.758622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.759394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:28.759698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.761676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.775048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 65/128] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.776030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.844593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:28.873279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375aa02-0be3-4aca-be96-aa39babb9f95 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.886592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d391ad-9eb5-436c-8d72-93a2cb00a2d2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:28.911668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.912730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.913100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.913467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/19194edf08ae47abb66f1bcede072b3a/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.915799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, user_id=19194edf08ae47abb66f1bcede072b3a, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.917573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.926932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:28.928355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:28.928929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:28.929512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:28.931112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:28.932866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 64/129] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:28 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/19194edf08ae47abb66f1bcede072b3a/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:28.933548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:28.933666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.936336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 66/130] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:28.937541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:28.978481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.058540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffc04-15e1-499b-8f6e-04364b0c9d2f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.080347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90590960-4fc4-437e-a2c5-625ac2e3cdd9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.102150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.103072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.103347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.103618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.104919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.106970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.113727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 67/131] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:29.113727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.126583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.127865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.128380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.128873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] PATH_INFO: `/v3/projects/56fec3706a6942efbc3b76c41cf8e257` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.130415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] RBAC: Authorizing `identity:get_project(project_id=56fec3706a6942efbc3b76c41cf8e257)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.132216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.134343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 65/132] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:28 2022] GET /identity/v3/projects/56fec3706a6942efbc3b76c41cf8e257 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:29.135443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.141116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.248337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.254099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d86426-3624-4207-989e-9916ef873dca None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.259363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202d9f9-e652-4ded-bb1a-f6efe9036749 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.298973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.299173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.300003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.300320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.300599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.300957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.301498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.301867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.302153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.303405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.303746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.305186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 68/133] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:29 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:29.305629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.306552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.307897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 66/134] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:29 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:29.313632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.403973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.436163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3c3a84-b73d-494c-9aa3-f0dda3cc1719 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.438677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311932a4-5940-42f9-a9f5-05ec2a72367d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.475219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.476187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.476476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.476755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/d1bd7595a3f7469e9385fd3e6286b86e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.478691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, user_id=d1bd7595a3f7469e9385fd3e6286b86e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.479774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.480713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.481143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.481616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.482067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] PATH_INFO: `/v3/projects/56fec3706a6942efbc3b76c41cf8e257/users/19194edf08ae47abb66f1bcede072b3a/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.484874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] RBAC: Authorizing `identity:create_grant(project_id=56fec3706a6942efbc3b76c41cf8e257, user_id=19194edf08ae47abb66f1bcede072b3a, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.486757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfae9dd-7922-4852-af84-1d20909a4584 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.497197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 67/135] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:29 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/d1bd7595a3f7469e9385fd3e6286b86e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:29.504533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.519869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 69/136] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:29 2022] PUT /identity/v3/projects/56fec3706a6942efbc3b76c41cf8e257/users/19194edf08ae47abb66f1bcede072b3a/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:29.522156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79e66-0977-461a-a4c4-1f24c106901f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.522667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79e66-0977-461a-a4c4-1f24c106901f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.523133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a79e66-0977-461a-a4c4-1f24c106901f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.526780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 70/137] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:29.532432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.532760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.533044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.565879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:29.567957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:29.611720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.687836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8b16c-2cf2-4845-b901-61f904a80942 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:29.729772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:29.742348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:29.743333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.743621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.743904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/19194edf08ae47abb66f1bcede072b3a/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.746793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, user_id=19194edf08ae47abb66f1bcede072b3a, role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:29.748458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0298e-b6e7-4c4a-a184-453179148296 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:29.753916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 71/138] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:29.771431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 68/139] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:29 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/19194edf08ae47abb66f1bcede072b3a/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:29.801472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:29.927887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4778-1276-4b39-9f65-64fe611f0fe4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.928825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4778-1276-4b39-9f65-64fe611f0fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.929284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe4778-1276-4b39-9f65-64fe611f0fe4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.930858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 69/140] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:29.937076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:29.937672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:29.938144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:29.957760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:29.959162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:29.960535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907efe72-821a-4c14-afba-a1064caef2d9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.034940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 70/141] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:30.046345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.047444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.047875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.048314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.052907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:30.054600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:30.056535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 72/142] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:30.058970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:30.062240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:30.126989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:30.172591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfaf29b-a02f-4153-8a12-07c743a911b5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.195214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:30.214321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.215532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.215813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.216090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.227401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:30.236288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:30.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:30.237925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 71/143] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:30.244320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:30.366172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981f030-b2cb-4f81-8025-8e70cd857ce9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.398257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186aaa2-cfe5-4e04-9034-a1daa0e8a55f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.448525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.449200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.449482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.449756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.450576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:30.450884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:30.452314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:30.466962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 72/144] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:30.473257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:30.494404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.495601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.496239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.496829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.497836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:30.499725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:30.563592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 73/145] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:30 2022] POST /identity/v3/users => generated 283 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:50:30.575745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:30.692683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89c6c4-bfb9-4f73-8c2b-3af5f2bd1789 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.749216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.750068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.750350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.750626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] PATH_INFO: `/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.756173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] RBAC: Authorizing `identity:get_user(user_id=dd44fad7c54a41f79e8b8b09bbc05a38)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:30.756173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:30.756573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 73/146] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:30 2022] GET /identity/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38 => generated 289 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:30.765376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:30.897637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:30.922666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f653-d37f-4711-9966-2bc41231d811 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:30.964845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:30.966090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:30.966371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:30.966642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:30.970778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:30.972299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4f12-f694-476d-b8df-2f7f1713472f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:30.974357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 74/147] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:30 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:30.979785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:31.112987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accd3d3-82bb-4d49-b1f2-4ba2034d6c55 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:31.126356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:31.159592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:31.160863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:31.161338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:31.161827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/dd44fad7c54a41f79e8b8b09bbc05a38/roles/af7440c704bf475ea053f7f233a318ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:31.164051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, user_id=dd44fad7c54a41f79e8b8b09bbc05a38, role_id=af7440c704bf475ea053f7f233a318ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:31.165801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3963f-d31e-4e45-8d16-9dce1df6e98d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:31.189945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 74/148] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:30 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/users/dd44fad7c54a41f79e8b8b09bbc05a38/roles/af7440c704bf475ea053f7f233a318ad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:31.712527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ba09-1fd6-40f9-bb88-0536d0684b11 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:31.712940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ba09-1fd6-40f9-bb88-0536d0684b11 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:31.713112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21ba09-1fd6-40f9-bb88-0536d0684b11 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:31.714732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 75/149] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:31.720976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:31.721267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:31.721546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:31.749132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:31.750336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:31.830081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 75/150] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:31.881773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ba09-1fd6-40f9-bb88-0536d0684b11 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:32.012021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e21ba09-1fd6-40f9-bb88-0536d0684b11 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:32.054128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:32.055003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.055282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.055593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.068040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:32.075915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:32.076819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:32.077574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 76/151] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:32.085234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:32.245670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:32.249642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c03268-42e8-43d7-852d-8e27adeb131d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:32.298104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:32.298792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.299073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.299346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.300107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:32.300432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:32.301834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:32.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 76/152] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:32.321345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:32.337348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:32.454724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a0d54-9ff8-4dad-ae59-1a6361e3f366 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:32.492968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:32.493864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.494137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.494405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.495627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:32.497118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efdaba-d9c8-4289-8c99-0809e946b3b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:32.499020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 77/153] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:32 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:32.504340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:32.591363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad5f69-12be-4ab9-bab9-b989892ef577 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.591649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad5f69-12be-4ab9-bab9-b989892ef577 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.591827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad5f69-12be-4ab9-bab9-b989892ef577 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.593475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 78/154] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:32.599916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.600252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.600525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.629549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:32.630794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:32.656581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd03b4c-b5e2-4c24-a507-472428c61055 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:32.721586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:32.722250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:32.722525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:32.722794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:32.761687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 79/155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:32.781191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:32.796571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:32.801329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:32.847780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:32.849228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f349bb-da12-46e4-b029-31f1d414bd66 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:33.028392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 77/156] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:33.029593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d21ed-5f2d-432a-9ba0-58b954e5b8d8 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.029886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d21ed-5f2d-432a-9ba0-58b954e5b8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.030165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d21ed-5f2d-432a-9ba0-58b954e5b8d8 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.036501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 78/157] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:33.037548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d21ed-5f2d-432a-9ba0-58b954e5b8d8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:33.051188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d21c4-934b-41af-9616-4a3f891712be None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:33.136941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:33.138024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.138442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.138839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.144553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:33.165308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4e1b7a22-3409-44c3-871a-b5f44903fbd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:33.177685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:33.178811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:33.179647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 80/158] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:33.180797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80383206-5dd8-413f-a7b1-f9e45f10b097 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.180797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80383206-5dd8-413f-a7b1-f9e45f10b097 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.180797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80383206-5dd8-413f-a7b1-f9e45f10b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.200931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d21ed-5f2d-432a-9ba0-58b954e5b8d8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:33.225142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-80383206-5dd8-413f-a7b1-f9e45f10b097 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:33.226337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80383206-5dd8-413f-a7b1-f9e45f10b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:33.261458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:33.262395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.262684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.262948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.264209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:33.265699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:33.267562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 79/159] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:33.268508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:33.303778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:33.311476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 81/160] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:33.313008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9589d7-09ac-42b9-9a14-df576243329e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.313459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9589d7-09ac-42b9-9a14-df576243329e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.313942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9589d7-09ac-42b9-9a14-df576243329e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.319568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 82/161] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:33.320612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9589d7-09ac-42b9-9a14-df576243329e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:33.470052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe19d80-dd07-44fa-ab4a-d80f2a5ecdc6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:33.521806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9589d7-09ac-42b9-9a14-df576243329e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:33.528486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:33.542434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:33.543179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.543461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.543735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.544655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:33.544962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:33.546431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36539445-bebc-4a73-944d-64046e9fadc9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:33.561096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 80/162] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:33.562661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.562956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.563236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.585169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:33.585859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.586143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.586416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.587291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:33.587603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:33.589296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:33.606208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:33.607479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:33.609497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 83/163] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:33.610367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:33.711026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:33.769110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a4770a-f80b-4568-bb93-de742deae238 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:33.776022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 81/164] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:33.776949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:33.806022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:33.806861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:33.807138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:33.807462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:33.830771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:33.849999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:33.850935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:33.851690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 84/165] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:33.852337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.035945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85895ba6-983e-489f-9ca0-a1d95401bc37 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.084483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.088221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8124f-2499-4cc3-aad9-272e02b6eb1a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.116596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.117559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.117845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.118116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.119385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.120982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.122826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 82/166] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:34.124631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.129832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.169724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.170561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.170843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.171119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.201022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:34.208829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:34.209691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:34.210463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 85/167] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:34.211170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.328022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b83806-e4b0-4aee-942b-41b7e8599527 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.380356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491cc9e-c31a-465d-aef4-8c54ff452504 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.408935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141782df-6644-40be-9e58-198527ef443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.409628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141782df-6644-40be-9e58-198527ef443d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.410110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141782df-6644-40be-9e58-198527ef443d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.410519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141782df-6644-40be-9e58-198527ef443d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.411453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141782df-6644-40be-9e58-198527ef443d None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:34.411909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141782df-6644-40be-9e58-198527ef443d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.413515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141782df-6644-40be-9e58-198527ef443d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.425818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.426695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.427115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.427524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.429556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 83/168] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:34.430479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141782df-6644-40be-9e58-198527ef443d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.491744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.528759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.530501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d11370-ce25-4143-a2e6-c2cede80c83b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.548468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.606214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141782df-6644-40be-9e58-198527ef443d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.647006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.648458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.648885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.649302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.650233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:34.650728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.652392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.662478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 84/169] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:34.664011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.715492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 86/170] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:34.716942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513e09-a476-43cb-a50e-c37bf191ff37 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.717228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513e09-a476-43cb-a50e-c37bf191ff37 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.717499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72513e09-a476-43cb-a50e-c37bf191ff37 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.718903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 87/171] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:34.719611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513e09-a476-43cb-a50e-c37bf191ff37 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:34.793612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108222c8-b33d-46b5-925c-30add96a66f1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.824867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.834620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:34.860695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72513e09-a476-43cb-a50e-c37bf191ff37 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:34.867307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.868324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.868622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.868871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] PATH_INFO: `/v3/users/19194edf08ae47abb66f1bcede072b3a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.870483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=19194edf08ae47abb66f1bcede072b3a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.872206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8308fd2-e328-410b-94fb-330768ae9dd5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.878570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 85/172] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/users/19194edf08ae47abb66f1bcede072b3a => generated 275 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:34.878570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881054-3968-4283-977a-ef1469843993 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.878570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881054-3968-4283-977a-ef1469843993 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.878570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21881054-3968-4283-977a-ef1469843993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.914854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-21881054-3968-4283-977a-ef1469843993 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:34.916617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21881054-3968-4283-977a-ef1469843993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:34.936893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:34.938135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:34.938607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:34.939090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] PATH_INFO: `/v3/users/d1bd7595a3f7469e9385fd3e6286b86e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:34.941320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] RBAC: Authorizing `identity:get_user(user_id=d1bd7595a3f7469e9385fd3e6286b86e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:34.948141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:34.948141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 88/173] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/users/d1bd7595a3f7469e9385fd3e6286b86e => generated 247 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:34.948141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.052076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 86/174] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:35.053046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881054-3968-4283-977a-ef1469843993 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.120947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a79c50-56bf-405b-a4ec-b4b0f4736334 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.157949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.159203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.159680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.160184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.161637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.163315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.165310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 89/175] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:34 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:35.166330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.178490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21881054-3968-4283-977a-ef1469843993 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.183211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.193564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.218118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.218785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.219066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.219336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.281298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1625ada-4765-441d-b076-b3f0297b09de None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.286175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.287687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ec693-0e09-4a15-9d43-ed6d23615090 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.319578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.320279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.320551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.320824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.391650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.393093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.394825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 87/176] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:35.396112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fead5a-fba6-41a6-872a-408e97a6a142 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.396421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fead5a-fba6-41a6-872a-408e97a6a142 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.396692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fead5a-fba6-41a6-872a-408e97a6a142 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.400243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 88/177] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:35.400243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fead5a-fba6-41a6-872a-408e97a6a142 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.414952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.415378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.507016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 90/178] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:35.508087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.515321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fead5a-fba6-41a6-872a-408e97a6a142 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.551575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.552443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.552723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.552995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.563420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8b972066-871a-4b3c-89cd-b985ee9a4482 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:35.571406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:35.572324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:35.573324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 89/179] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:35.574294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f496b-48c2-45b6-89d7-0c050cd12dda None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.574427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f496b-48c2-45b6-89d7-0c050cd12dda None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.574862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f496b-48c2-45b6-89d7-0c050cd12dda None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.576339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 90/180] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:35.576864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f496b-48c2-45b6-89d7-0c050cd12dda None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.623096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62061df5-4ce9-4b53-9854-41c61a99be81 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.638276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.656748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.658828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.659498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.659773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.660044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.660931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:35.661240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.662734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960fb99-527f-4206-b17a-b66a71d4ed8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.668643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 91/181] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:35.669821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.670104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.670381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.688951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f496b-48c2-45b6-89d7-0c050cd12dda None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.696973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:35.698287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:35.734119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.735011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.735292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.735579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] PATH_INFO: `/v3/projects/56fec3706a6942efbc3b76c41cf8e257` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.736804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] RBAC: Authorizing `identity:get_project(project_id=56fec3706a6942efbc3b76c41cf8e257)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.738321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.745163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 91/182] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/projects/56fec3706a6942efbc3b76c41cf8e257 => generated 312 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:35.745163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.779002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 92/183] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:35.785194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:35.869582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418db9-ef62-43ed-9577-5482d139a7de None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.905606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858522a9-7380-4fde-8b5e-19ba57d1b6e7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:35.909186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.910089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.910380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.910652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.911921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.913561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe38e54-49a2-4cbd-bfb9-ea5089450be2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.915081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.915429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 92/184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:35.916782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.917085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.917356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.933881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:35.935119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:35.937259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:35.943596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:35.944321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.944596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.944865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.945635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:35.945945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:35.947339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb169351-7b1d-4abe-be61-20793ae74832 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:35.955742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 93/185] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:35.956893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c306-e319-427c-a939-b32af5fc92e2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:35.957176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c306-e319-427c-a939-b32af5fc92e2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:35.957445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c306-e319-427c-a939-b32af5fc92e2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:35.958686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 94/186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:35.959348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c306-e319-427c-a939-b32af5fc92e2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.006006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 93/187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:36.006855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.060717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c306-e319-427c-a939-b32af5fc92e2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.095147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.095806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.096086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.096394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.097264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=56fec3706a6942efbc3b76c41cf8e257, user.id=19194edf08ae47abb66f1bcede072b3a) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:36.097573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.099028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.102879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180151d1-c4b0-4ecd-833a-24cfaf6576b5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.104902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 95/188] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:35 2022] GET /identity/v3/role_assignments?user.id=19194edf08ae47abb66f1bcede072b3a&scope.project.id=56fec3706a6942efbc3b76c41cf8e257&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.108653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.142424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.143271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.143575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.143811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.149215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.156895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.162123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:36.171999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:36.173151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:36.173943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 94/189] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:36.175130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.232856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d98631-9136-494b-bf5c-2a441583787f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.274984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.275669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.275942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.276351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.277227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=d1bd7595a3f7469e9385fd3e6286b86e) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:36.277545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.279115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe07a5-78ca-471e-859c-21260fed948d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.285710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad315bba-a2ef-4c56-92dc-e28caa05a0f8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.286385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 96/190] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/role_assignments?user.id=d1bd7595a3f7469e9385fd3e6286b86e&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.287428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.287710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.287984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.307213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:36.308642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:36.336171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.337085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.337368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.337659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] PATH_INFO: `/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.338960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] RBAC: Authorizing `identity:get_user(user_id=dd44fad7c54a41f79e8b8b09bbc05a38)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.340870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.344283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 95/191] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/users/dd44fad7c54a41f79e8b8b09bbc05a38 => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.344283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.412236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 97/192] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:36.412236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.436636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.438701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.480812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77887103-b9e3-4bf6-abef-0798009d9420 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.520303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.521131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.521407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.521669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.527207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a81b1-e423-466a-89c3-93ce344ba4fe None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.532295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:36.539896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:36.540878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:36.541728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 96/193] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:36.542381 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.564379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.565064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.565346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.565620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.566384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:36.566688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.568085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.576691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 98/194] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.577027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.644911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f3cfb-d0a8-4413-8b5c-0bae79a22f07 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.666724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.670234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.677146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a479f8f-c1e3-4000-94d1-17435956344b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.679163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.679857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.680169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.680472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.711155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.711966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.712308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.712578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.713840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.715618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.717293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 99/195] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.718053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.751003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.752560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.815490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b1966-a7c7-4753-b27c-c3ad6de06350 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.850106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.850771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.851047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.851307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:36.851550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 97/196] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:36.852144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:36.852427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.852540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:36.853915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:36.863007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 100/197] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:36.864965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:36.879578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.887152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:36.954443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec27f0d-c31b-4578-93ff-21920721ebe3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.968982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4641bf-bc24-4b73-a7a2-65831ae10d4f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:36.988962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:36.989914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:36.990211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:36.990472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.001668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.002345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.002612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.002877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.003604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.003701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.005110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.005221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.006857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 98/198] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:36 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:37.007647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.025119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 101/199] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:36 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:37.025934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.117651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.122079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.138928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c98fa-6220-4177-80e0-93b5f299f49c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.148870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fa885-a0c0-4912-8363-c2e65d0d0e90 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.177385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.178288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.178608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.178838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.180066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.181565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.183402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 99/200] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:37.184207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.189258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.190217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.190439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.190708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.192056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.194046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.196147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 102/201] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:37.197352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.300281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825204-c49a-45e1-8695-d3b6ecbf1c40 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.319033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44468faf-ef19-4dc6-9223-879e5d5c56cd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.343569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.344268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.344551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.344824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.362618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.363317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.363777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.365216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.366319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89, user.id=dd44fad7c54a41f79e8b8b09bbc05a38) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:37.366708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.369179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.381295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.383138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 103/202] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/role_assignments?user.id=dd44fad7c54a41f79e8b8b09bbc05a38&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=af7440c704bf475ea053f7f233a318ad => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:37.388331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.401835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.500615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.504676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.620640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e981c-56a4-40aa-b22d-09cc3e93eb8e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.682254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.683823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.684477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.685049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.719933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 100/203] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:37.728601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:37.798830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.831382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.832901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.850421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ae1ea-f3ca-476f-a71d-4c93f372e615 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:37.880515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:37.890023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:37.891360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:37.891854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:37.892383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:37.893810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:37.895589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:37.897918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 101/204] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:37.903557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:38.052661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 104/205] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:38.053087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c6a52-bfb7-48bc-b66d-3526fc2a59db None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:38.058074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:38.077800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:38.094716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:38.095673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:38.096163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:38.096627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:38.097677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=22bdab3c449947829db6e6597f2d7762) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:38.098174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:38.099850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:38.106114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 102/206] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:37 2022] GET /identity/v3/role_assignments?user.id=22bdab3c449947829db6e6597f2d7762&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:38.165611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4211a4-aeda-40bc-b4e1-1ad50423d33a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:38.200627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:38.208826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:38.210329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:38.210803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:38.211285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:38.213067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:38.215369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05641264-cb8c-43b6-a739-13f08f645921 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:38.217990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 105/207] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:38 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:38.226626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:38.333194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469ebb-1d5e-42f2-95b4-047b02cfc880 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:38.371070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:38.371743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:38.372019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:38.372323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:38.373174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=22bdab3c449947829db6e6597f2d7762) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:38.373497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:38.374971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d5d1e-58f2-43ef-a714-9aa558e4803c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:38.381514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 103/208] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:38 2022] GET /identity/v3/role_assignments?user.id=22bdab3c449947829db6e6597f2d7762&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:39.245962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4a7e-5a06-48b0-959a-4d9942b10baa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.246471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4a7e-5a06-48b0-959a-4d9942b10baa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.246471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e4a7e-5a06-48b0-959a-4d9942b10baa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.247815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 106/209] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:39.253065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8d2a-5dd5-498f-b5e1-1efd08f72dc1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.253460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8d2a-5dd5-498f-b5e1-1efd08f72dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.253615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413c8d2a-5dd5-498f-b5e1-1efd08f72dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.274471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-413c8d2a-5dd5-498f-b5e1-1efd08f72dc1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:39.275997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-413c8d2a-5dd5-498f-b5e1-1efd08f72dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:39.321532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:39.349787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 104/210] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:39.355130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6ea5-0c37-4237-8595-e273ecce1a70 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.355485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6ea5-0c37-4237-8595-e273ecce1a70 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.355825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d6ea5-0c37-4237-8595-e273ecce1a70 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.357355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 107/211] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:39.366051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da49b-f083-4429-9ede-e203fa14825c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.366051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da49b-f083-4429-9ede-e203fa14825c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.366051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da49b-f083-4429-9ede-e203fa14825c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.382613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-144da49b-f083-4429-9ede-e203fa14825c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:39.384103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d6ea5-0c37-4237-8595-e273ecce1a70 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.384946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-144da49b-f083-4429-9ede-e203fa14825c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:39.463553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 105/212] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:39.488042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da49b-f083-4429-9ede-e203fa14825c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.496246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d6ea5-0c37-4237-8595-e273ecce1a70 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:39.532274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:39.533604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.533604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.533805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.544655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:39.552903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:39.553781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:39.554543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 108/213] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:39.560216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.601237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:39.622240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da49b-f083-4429-9ede-e203fa14825c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:39.636219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:39.679228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b617cd83-d200-478a-aef1-1db0317eeac9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:39.679723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:39.680580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.680857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.681129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.682454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:39.684795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:39.686601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 106/214] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:39.692525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.723249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:39.724022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.724416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.724744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.725567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:39.725933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:39.727391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:39.736255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 109/215] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:39.741431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.815865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e3336-59b7-4269-9ab9-2f6af04f2cce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:39.853081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ed4be-9c97-4211-9859-e937d9910c61 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:39.854993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:39.858035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:39.858979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.859186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.859478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.860222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:39.861694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:39.888019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 107/216] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:39 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:50:39.903173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:39.904513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:39.904993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:39.905517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] PATH_INFO: `/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:39.922610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] RBAC: Authorizing `identity:get_user(user_id=51e28d349bfd4a3ebb77059d65ce2ecc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:39.924480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747004ca-abc7-405a-8e0e-05a29d85c2c1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:39.926583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 110/217] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:39 2022] GET /identity/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:39.934620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:39.975209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.052305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ca07c-95d4-4d1e-8ba8-427773b67b1f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.091116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.092101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.092601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.093057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.166485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:40.168378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:40.180011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b096-5d30-4883-a8db-ed3206adae90 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.180458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b096-5d30-4883-a8db-ed3206adae90 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.180735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496b096-5d30-4883-a8db-ed3206adae90 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.182336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 111/218] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:40.189513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.189788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.190055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.208857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.211084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:40.212632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:40.300042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:40.304204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 108/220] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:40.310486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.326892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.412835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.437402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d1ac0e-5a7f-4eb8-88dc-cae4a1971202 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.475032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c39d7-4986-4678-9327-6e722ceca6c1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.488775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.489665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.489946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.490220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.493159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:40.494671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:40.496639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 113/221] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:40.502895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.545201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.551144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.552455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.552939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.553981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.567948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-98d60717-0c07-484b-94a2-1f9a006c3d41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:40.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:40.578594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:40.579376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:40.581898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 109/222] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:40.583435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd422a2-7997-4274-a1b9-cd4203450547 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.583899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd422a2-7997-4274-a1b9-cd4203450547 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.584378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd422a2-7997-4274-a1b9-cd4203450547 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.585879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 110/223] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:40.587318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd422a2-7997-4274-a1b9-cd4203450547 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.629323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a80ada-b8b1-406a-9ee5-8ca2e7ca86f8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.677750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.678345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.678625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.678898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.679758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=51e28d349bfd4a3ebb77059d65ce2ecc) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:40.680066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:40.681553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdaf485-91e9-494c-924d-16178c0804a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:40.689840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 114/224] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/role_assignments?user.id=51e28d349bfd4a3ebb77059d65ce2ecc&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:40.691916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.692225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.692505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.713566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd422a2-7997-4274-a1b9-cd4203450547 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.713758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:40.714871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:40.742554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.785079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.785765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.786050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.786323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.787102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:40.787409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:40.788863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:40.815244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 111/225] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:40.817566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.852005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 115/226] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:40.889470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:40.891811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:40.947650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8d24b-a82b-4001-a992-a775639927a9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:40.990889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:40.991801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:40.992477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:40.992742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:40.994287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:40.996151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:40.998530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 112/227] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:41.004128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.032273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645da8b3-2ab4-43e4-8f8f-a6a82ebf23e9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.097476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.098296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.098575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.098845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.118482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:41.126259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:41.127135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:41.127904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:41.138806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 116/228] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:41.139685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.149805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60bd36-17ee-4a1c-a4ee-5435ade29188 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.163657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:41.193116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:41.219514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335100f5-1828-4382-ae20-219367918284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.220426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335100f5-1828-4382-ae20-219367918284 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.220707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335100f5-1828-4382-ae20-219367918284 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.220982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335100f5-1828-4382-ae20-219367918284 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.223454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335100f5-1828-4382-ae20-219367918284 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.224973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335100f5-1828-4382-ae20-219367918284 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.232221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 113/229] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:41 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:41.234944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335100f5-1828-4382-ae20-219367918284 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.340491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335100f5-1828-4382-ae20-219367918284 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.344746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733d191e-a28d-46db-b7c2-8833edcfb547 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.374856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.375764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.376039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.376342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/22bdab3c449947829db6e6597f2d7762/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.378596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, user_id=22bdab3c449947829db6e6597f2d7762, role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.380067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.407961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 114/230] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:41 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/22bdab3c449947829db6e6597f2d7762/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:41.409714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.410439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.410727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.411007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.411785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:41.412091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.413666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.431968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 117/231] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:41.438091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.509206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:41.570497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916815f0-fa1b-421e-977b-0e2062e6ef1c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.617192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.618085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.618367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.618643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.620620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.621407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.623429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 115/232] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:41 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:41.629630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.706752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:41.740271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a746f96-43e4-433a-bb06-54f791b5d9b0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.780234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.781123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.781404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.781677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.782884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.784376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b2bb4d-bd20-4101-937d-4bc7bb67827a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.786113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 118/233] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:41 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:41.791943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:41.919964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e75fe6-0b98-47cd-be06-5151704a69af None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:41.945238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:41.969256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:41.970167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:41.970449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:41.970724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/22bdab3c449947829db6e6597f2d7762/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:41.977421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, user_id=22bdab3c449947829db6e6597f2d7762, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:41.978912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1e662-954d-4254-a582-c43aa59b274d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:41.998089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 116/234] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:41 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/22bdab3c449947829db6e6597f2d7762/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:42.267193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246642d5-439f-4f00-842b-663b91beb223 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.267379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246642d5-439f-4f00-842b-663b91beb223 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.267644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246642d5-439f-4f00-842b-663b91beb223 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.269246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 119/235] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:42.276224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.276519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.276853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.296921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:42.298138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:42.367286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 117/236] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:42.390272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246642d5-439f-4f00-842b-663b91beb223 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:42.510284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246642d5-439f-4f00-842b-663b91beb223 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:42.553909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:42.554726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.555005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.555279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.572388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:42.579778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9aea6304-7b7c-4237-a8f6-b59343933d82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:42.585087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:42.585979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:42.586742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 120/237] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:42.594020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:42.656145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e722-dbd0-4b62-828a-9c8101aba5ae None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.656145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e722-dbd0-4b62-828a-9c8101aba5ae None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.656145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d362e722-dbd0-4b62-828a-9c8101aba5ae None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.657649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 121/238] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:42.662922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.663441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.663909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.705136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:42.706707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:42.724499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f64ec8-6c3f-4c6b-9904-9bf249154a84 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:42.725368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:42.755348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:42.756439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.756907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.757375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.758342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:42.758840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:42.760503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:42.769719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 118/239] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:42.775814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:42.827249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 122/240] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:42.867625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:42.910771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122472-d8ac-4bc0-bf41-55187e782c2c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:42.956228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:42.957604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:42.958067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:42.958522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] PATH_INFO: `/v3/users/aa608560814548b2bc70e44816fa8071` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:42.973643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] RBAC: Authorizing `identity:get_user(user_id=aa608560814548b2bc70e44816fa8071)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:42.975553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:42.977515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 119/241] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:42 2022] GET /identity/v3/users/aa608560814548b2bc70e44816fa8071 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:42.985000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.005797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3584a8a-7b3e-4ac4-9feb-f0d493730c10 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.031074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.054071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.067378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.068215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.068495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.068847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.070861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.072372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.074512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 123/242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:43.080766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.148401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb55d82-7697-48a1-afb2-667e8287842b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.184851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.186166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.186453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.186728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.262773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.264596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.281810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeebf23-e4fb-4bad-9f04-6a63fb2b75dd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.293692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.316297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.316981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.317251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.317526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.318246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.319696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098cf88c-cdbb-4765-921f-e832847210be None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.346378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 124/243] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:43 2022] POST /identity/v3/users => generated 293 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:43.347916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fda9-94fe-408a-824c-34f234229add None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.348424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fda9-94fe-408a-824c-34f234229add None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.348887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262fda9-94fe-408a-824c-34f234229add None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.350441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 125/244] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:43.366396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151057-f978-40ee-9995-26b063ea357c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.367050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151057-f978-40ee-9995-26b063ea357c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.367511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7151057-f978-40ee-9995-26b063ea357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.393294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 120/245] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:43.405229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.407111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f7151057-f978-40ee-9995-26b063ea357c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:43.408857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7151057-f978-40ee-9995-26b063ea357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:43.462662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.486781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 126/246] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 07 03:50:43.509935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151057-f978-40ee-9995-26b063ea357c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.597716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df58ef4-b1ac-4fdd-afcc-32413af77dce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.622308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7151057-f978-40ee-9995-26b063ea357c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.633514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.644151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.645190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.645471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.645742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.646949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.648623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.655384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 121/247] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:43 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:43.656801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.669739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.670929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.671413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.671865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.683593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:43.693051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:43.693929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:43.694695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:43.697593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 127/248] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:43.703653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.758825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:43.787181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108d1c3-0c61-44ce-a219-f7fa2a8b6ffd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.830823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.831738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.832025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.832330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.833587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=aa608560814548b2bc70e44816fa8071) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:43.833904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.835662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.836844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e682d08-1a98-4959-af93-d41ce40dbfba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:43.848412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 122/249] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:43 2022] GET /identity/v3/role_assignments?user.id=aa608560814548b2bc70e44816fa8071&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=af7440c704bf475ea053f7f233a318ad => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:43.880222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:43.881346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:43.881826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:43.882286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:43.883304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:43.883808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:43.885547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:43.895871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 128/250] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:43.902098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:43.979340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:44.040885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5665348a-610d-4240-adb2-91ebacdc14e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:44.077898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:44.078833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.079109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.079376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] PATH_INFO: `/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.080728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] RBAC: Authorizing `identity:get_user(user_id=51e28d349bfd4a3ebb77059d65ce2ecc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:44.082212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d17e6c9-0c4f-4b24-80b4-67fec0bff011 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:44.084248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 123/251] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:43 2022] GET /identity/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:44.089724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:44.182082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097235-af0f-421f-80e8-b669084c1bd7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.182628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097235-af0f-421f-80e8-b669084c1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.183097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097235-af0f-421f-80e8-b669084c1bd7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.184921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 124/252] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:44.192270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.192578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.192832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.223339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:44.224562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:44.230344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae459-778b-4a12-8b66-c76878bd7922 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:44.236410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:44.284274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:44.285167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.285439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.285705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.288102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:44.289589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:44.291417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 129/253] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:44 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:44.297974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:44.388616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 125/254] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:44.423789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:44.449726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaad69b1-eb6c-4b56-ae1d-1684fd8f7dd4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:44.517667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:44.518633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.518914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.519187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/51e28d349bfd4a3ebb77059d65ce2ecc/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.524849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, user_id=51e28d349bfd4a3ebb77059d65ce2ecc, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:44.526356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:44.534619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:44.549416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:44 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/51e28d349bfd4a3ebb77059d65ce2ecc/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 03:50:44.631072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c00e4c-957e-49c7-b6ef-502b4e2bed25 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:44.694493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:44.695320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.695594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.695857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.712358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e4b58a0e-5b16-42f0-8e55-2d72c1094cae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:44.721059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:44.722155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:44.723144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 126/256] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:44.729888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:44.748335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e84-8a1c-4209-b2c3-2fa868d57849 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.748648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e84-8a1c-4209-b2c3-2fa868d57849 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.748889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b454e84-8a1c-4209-b2c3-2fa868d57849 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.750563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 127/257] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:44.755828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.756140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.756397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.789410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:44.793376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:44.794664 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:44.914007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 128/258] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:44.925622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8e4f2-002b-4d4f-88a4-7695da6e83cc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:44.961566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:44.963386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:44.964028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:44.964334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:44.964608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:44.965696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:44.966004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:44.967401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:44.987674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 131/259] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:44.993047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.018138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:45.078325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8d6c6-ab33-4832-8bb1-1790d5c406c8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.123472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.124315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.124596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.124866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.149481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:45.158951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:45.159812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:45.160693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:45.170374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 129/260] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:45.190704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:45.194659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.214795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d266dc9e-3d48-4e81-ac29-cf542a01ae1c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.258291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.260979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.261267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.261544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.264600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:45.266070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:45.267752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 132/261] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:44 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:45.275052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.415045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24340fdb-80e2-47aa-ba52-dd20d07c91ac None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.438251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173b16d-7a9a-4be0-8f67-7fe6869c28d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.459399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:45.464034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.464764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.465418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.465633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.503869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:45.530325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.531017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.531298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.531674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.532574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:45.532886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:45.534287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:45.545971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:45.547483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:45.551861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 130/262] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:45.557592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.701510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 133/263] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:45.713048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.815982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fed0c-5278-46f2-b73e-7b95230bfb19 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.839529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:45.888025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.889731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.890009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.890283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] PATH_INFO: `/v3/users/22bdab3c449947829db6e6597f2d7762` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.891995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] RBAC: Authorizing `identity:get_user(user_id=22bdab3c449947829db6e6597f2d7762)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:45.893506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:45.895356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 131/264] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/users/22bdab3c449947829db6e6597f2d7762 => generated 283 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:45.901640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2968d9-11fc-4485-a0f9-c22c21590a00 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:45.903966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.962463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:45.963383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:45.963664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:45.963934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:45.966074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:45.967542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:45.969604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 134/265] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:45.975163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:45.986269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:46.110808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b13cc7-8c3a-427e-b0cb-6770b4e38094 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:46.138021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64f7a16-feeb-4e9e-b2a1-3f5b840c7515 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:46.157317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:46.158085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.158369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.158640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.202458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:46.228887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:46.229575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.229860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.230143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.230994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=22bdab3c449947829db6e6597f2d7762) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:46.231303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:46.232767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:46.237806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:46.239565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:46.250666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 135/266] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/role_assignments?user.id=22bdab3c449947829db6e6597f2d7762&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 608 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:46.282887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:46.353441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 132/267] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:46.359493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:46.516284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0a13c-ba27-4b22-8692-0825dae2e9cc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:46.561962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:46.562850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.563125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.563391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.564608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:46.566062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f106b10-3e5f-4c47-b3ac-f716338c62db None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:46.568140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 136/268] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:46 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:46.574021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:46.726830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272deb15-ce76-4a3d-8a9e-b1db3bc11af8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:46.739373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248699-b73a-401f-a323-798275107970 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.739699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248699-b73a-401f-a323-798275107970 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.739920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12248699-b73a-401f-a323-798275107970 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.741348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 137/269] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:46.749343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ccf25-a3e6-469c-8db1-9f59ff607e8f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.749620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ccf25-a3e6-469c-8db1-9f59ff607e8f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.749890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ccf25-a3e6-469c-8db1-9f59ff607e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.774823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:46.775890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:46.776413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:46.776899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:46.777973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=22bdab3c449947829db6e6597f2d7762) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:46.778534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:46.780232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:46.787284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 133/270] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:46 2022] GET /identity/v3/role_assignments?user.id=22bdab3c449947829db6e6597f2d7762&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:46.792221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-033ccf25-a3e6-469c-8db1-9f59ff607e8f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:46.792221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-033ccf25-a3e6-469c-8db1-9f59ff607e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:46.888082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:46.899721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 138/271] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 07 03:50:46.945690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:46.949298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.067517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0ed4-5fe1-4943-81dd-17b978d3c9da None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.106994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.107812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.108087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.108391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.119494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:47.124860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3fef-1475-47d7-8ca3-31d958f280b3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.125147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3fef-1475-47d7-8ca3-31d958f280b3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.125427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e3fef-1475-47d7-8ca3-31d958f280b3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.126975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 139/272] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:47.129478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:47.130621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:47.131392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:47.132001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4629c0-851e-4000-ab58-b62e3c86c4bf None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.132001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4629c0-851e-4000-ab58-b62e3c86c4bf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.132497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4629c0-851e-4000-ab58-b62e3c86c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.138393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 134/273] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:47.141508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.151038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ba4629c0-851e-4000-ab58-b62e3c86c4bf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:47.152263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ba4629c0-851e-4000-ab58-b62e3c86c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:47.223928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.246264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 140/274] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:47.249683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b839b-3d21-45cb-8482-1a43151d4fab None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.250611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b839b-3d21-45cb-8482-1a43151d4fab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.251104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505b839b-3d21-45cb-8482-1a43151d4fab None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.253199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 141/275] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:47.261267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae6ac-b067-4a3e-923f-d033ce9637c3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.261555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae6ac-b067-4a3e-923f-d033ce9637c3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.262016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abae6ac-b067-4a3e-923f-d033ce9637c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.276056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7cb31-e34e-41a5-a5e1-0751458ee7d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.280098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2abae6ac-b067-4a3e-923f-d033ce9637c3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:47.281319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2abae6ac-b067-4a3e-923f-d033ce9637c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:47.311097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.311768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.312041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.312342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.313095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:47.313390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.314781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.323620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 135/276] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:47.324403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.352196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 142/277] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:47.353536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc042d-cfa5-46e4-af3c-de376656f9d7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.353886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc042d-cfa5-46e4-af3c-de376656f9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.354163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc042d-cfa5-46e4-af3c-de376656f9d7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.355446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 143/278] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:47.356208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc042d-cfa5-46e4-af3c-de376656f9d7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.412371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.430448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeac83-aab2-46d0-a621-9d2cc24234d4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.453059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.460951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc042d-cfa5-46e4-af3c-de376656f9d7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.464483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.465596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.465873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.466144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.467334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.468863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0996d34-a9cf-4acd-8717-0b251caec917 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.470501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 136/279] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:47.471712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.471999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.472294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.488559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:47.489923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:47.496542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.497423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.497700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.497969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] PATH_INFO: `/v3/users/aa608560814548b2bc70e44816fa8071` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.499153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] RBAC: Authorizing `identity:get_user(user_id=aa608560814548b2bc70e44816fa8071)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.500671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.502412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 144/280] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/users/aa608560814548b2bc70e44816fa8071 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:47.503172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.557205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 137/281] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:47.557924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.604178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95f7113-7110-4118-9c1b-b4e495e324bb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.623781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.637688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.638497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.638780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.639055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.649139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:47.655463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37582d52-23e3-4dac-bc0e-09dfe494837d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:47.656912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:47.657765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:47.658558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 145/282] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:47.659217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.680338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.693112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.693892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.694170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.694437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.695146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.696623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.717036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 138/283] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:50:47 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:47.717848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.762723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3acf5-cf0d-4a8c-9842-e7635af76915 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.799898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.800812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.801089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.801385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.802733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.804253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.811205 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 146/284] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:47.811205 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.850886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48f93a-9bb1-4fc3-adef-a323af0a0c2f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.861678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.898244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.898693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.898980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.899255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.911095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:47.919034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:47.920063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:47.921039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:47.923068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 139/285] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:47.923957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:47.926431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49021e41-5509-4836-b5b2-609a1460fdd1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:47.972373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:47.973112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:47.973348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:47.973622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:47.974389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:47.974695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:47.975898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:47.976088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:47.988726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 147/286] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:47.989721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.062737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7865d8-0d9c-431f-b105-c8ec9b96a7fd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.101667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.103018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.103492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.104025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/aa608560814548b2bc70e44816fa8071/roles/af7440c704bf475ea053f7f233a318ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.106191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, user_id=aa608560814548b2bc70e44816fa8071, role_id=af7440c704bf475ea053f7f233a318ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.107854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.111309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e57baec-9b43-491c-90bf-0d2a9ac55c61 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.122908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:48.124692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 140/287] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:50:47 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/users/aa608560814548b2bc70e44816fa8071/roles/af7440c704bf475ea053f7f233a318ad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:48.125826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.150087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.150820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.151100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.151373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.152170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:48.152481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.154050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.164176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 148/288] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:48.169991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.317763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:48.323880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b3178-e418-448b-9970-b9ae5048f7b5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.366149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b69f43-aa85-4e22-af31-8cb29715560f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.372106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.373116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.373339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.373607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] PATH_INFO: `/v3/users/1d43d5270088403f9439f03abe1427d9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.388793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] RBAC: Authorizing `identity:get_user(user_id=1d43d5270088403f9439f03abe1427d9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.390283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.393362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 141/289] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:48 2022] GET /identity/v3/users/1d43d5270088403f9439f03abe1427d9 => generated 293 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:48.399161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.416893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.417868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.418154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.418428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] PATH_INFO: `/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.419746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] RBAC: Authorizing `identity:get_user(user_id=51e28d349bfd4a3ebb77059d65ce2ecc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.421237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.423104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 149/290] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:48 2022] GET /identity/v3/users/51e28d349bfd4a3ebb77059d65ce2ecc => generated 297 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:48.429516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.492688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:48.548468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f92d2-c561-4715-a90c-4064942028d4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.604711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c5ba3-f7d4-4eaf-9183-4df74ff2d84b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:48.632908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.633643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.633936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.634236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.635093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, user.id=1d43d5270088403f9439f03abe1427d9, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:48.635408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.636940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.644151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:48.645207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:48.645687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:48.646092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:48.646721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 142/291] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jul 7 03:50:48 2022] GET /identity/v3/role_assignments?user.id=1d43d5270088403f9439f03abe1427d9&scope.system=all&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:48.725352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:48.727069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:48.772194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:48.835998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 150/292] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 03:50:48.844243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:48.895543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:49.000673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746283b-d016-477f-93db-8c8715d03302 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:49.049714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:49.050603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:49.050876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:49.051144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:49.052362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:49.053819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea24a56-8bcc-4fd4-b4ca-92438fd57851 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:49.055530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 143/293] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:48 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:49.065253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:49.192757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92443b0d-d6f9-4939-89a2-957b6255f04e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:49.227978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:49.229154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:49.229665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:49.230122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:49.231162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=51e28d349bfd4a3ebb77059d65ce2ecc) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:49.231732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:49.233594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e77a505-49d2-4d08-b4cc-8a96e66c677b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:49.240675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 151/294] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:49 2022] GET /identity/v3/role_assignments?user.id=51e28d349bfd4a3ebb77059d65ce2ecc&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:50.102195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcfb-eff4-44d3-9f6d-603c3d20c7bb None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.102704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcfb-eff4-44d3-9f6d-603c3d20c7bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.102704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79dcfb-eff4-44d3-9f6d-603c3d20c7bb None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.104219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 144/295] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:50.109364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4a11-79be-4bb6-8674-187d9722c9ad None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.109747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4a11-79be-4bb6-8674-187d9722c9ad None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.109907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf4a11-79be-4bb6-8674-187d9722c9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.116037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.128082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ddaf4a11-79be-4bb6-8674-187d9722c9ad None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:50.129348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ddaf4a11-79be-4bb6-8674-187d9722c9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:50.199778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116324-958b-430a-9d98-957429bcc1f9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.199945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116324-958b-430a-9d98-957429bcc1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.200285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d116324-958b-430a-9d98-957429bcc1f9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.201071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 152/296] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:50.201871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 145/297] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:50.209273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.209562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.209835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.226045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116324-958b-430a-9d98-957429bcc1f9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.226756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:50.227917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:50.296165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 153/298] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:50.320070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.326516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.343468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d116324-958b-430a-9d98-957429bcc1f9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.388920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.395228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.396950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.397224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.398324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.400837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:50.402290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:50.409493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 146/299] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:50.410146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.442039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042e034-67e1-4d5f-83f1-fe181219874b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.483844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.484585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.484859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.485122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.499365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:50.508601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:50.509485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:50.510348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 154/300] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:50.515884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.539209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b2f32-d815-4e7f-9826-35d468bbaf18 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.584498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.585773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.586806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.587305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] PATH_INFO: `/v3/groups` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.588576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:50.591792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935869d-8b35-4d98-b3c8-cda0363be719 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:50.610446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 147/301] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jul 7 03:50:50 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:50:50.610446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbac2-97a1-4e7e-994b-b4761370b0c0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.610446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbac2-97a1-4e7e-994b-b4761370b0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.610446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcbac2-97a1-4e7e-994b-b4761370b0c0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.610446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 148/302] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:50.619297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.619578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.619852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.630512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791ec84-0250-442e-9810-ebf1f9f4fc44 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.638925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:50.640349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:50.653813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.667082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.678948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.679651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.679933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.680232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.681460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:50.681937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:50.683435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:50.698281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 155/303] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:50.699505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.722218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 149/304] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:50.747190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.827868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d7d4-8749-40db-a470-ae18cc2dd78d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.868136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12994ec7-8f18-4e19-8db4-44fd9d19c6c7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:50.884322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.885342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.885674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.886017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] PATH_INFO: `/v3/users/41725b7abf1f47d5bff0f39e59859b95` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.903105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] RBAC: Authorizing `identity:get_user(user_id=41725b7abf1f47d5bff0f39e59859b95)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:50.904793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:50.905959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:50.906828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.907045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 156/305] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/users/41725b7abf1f47d5bff0f39e59859b95 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:50.911620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.911620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.912822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.919151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cd43dabb-8e1d-485b-91a6-15ae685c8d25 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:50.929386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:50.931942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 150/306] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:50.934433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2b0b-a5a6-4786-92ab-fb1c01d5c075 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:50.936515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2b0b-a5a6-4786-92ab-fb1c01d5c075 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:50.936515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a2b0b-a5a6-4786-92ab-fb1c01d5c075 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:50.936515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 151/307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:50.936515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2b0b-a5a6-4786-92ab-fb1c01d5c075 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:50.946024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:50.970130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.027733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f8ddb-545d-4fa9-8da7-286e1384bd77 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.040076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a2b0b-a5a6-4786-92ab-fb1c01d5c075 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.064916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.065579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.065852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.066119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.067071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, user.id=41725b7abf1f47d5bff0f39e59859b95, scope.system=all) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:51.067493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.069088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96193453-cab1-4887-b9b9-336b6781c329 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.074828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 157/308] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/role_assignments?user.id=41725b7abf1f47d5bff0f39e59859b95&scope.system=all&role.id=af7440c704bf475ea053f7f233a318ad => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:51.075840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.076143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.076462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.084981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.096146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.104146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:51.105650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:51.106160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 152/309] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:51.111556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.194499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.208275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 158/310] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:51.230066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.248261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb4e3f-7f96-4eff-9e13-b78f7d06c69f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.284578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.292246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.293474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.293914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.294628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] PATH_INFO: `/v3/users/aa608560814548b2bc70e44816fa8071` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.296263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] RBAC: Authorizing `identity:get_user(user_id=aa608560814548b2bc70e44816fa8071)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.298533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.301438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 153/311] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/users/aa608560814548b2bc70e44816fa8071 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:51.307559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.349480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77450284-4edd-46c9-86ea-3a2006c5c284 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.386563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.387828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.388323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.388881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.400621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:51.409082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:51.409969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:51.410734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:51.413199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 159/312] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:50:51.420310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.433874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9defe1c6-cd34-4814-8edb-bff444c6628e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.478959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.480010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.480336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.480607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.485253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.531605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.536975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c571c-2e4d-4de5-adac-7fafc0eb0440 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.566883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.569089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.580660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.581345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.581620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.581886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.583061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:51.583361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.585175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.600271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 160/313] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:51.602856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.697025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 154/314] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:51.703013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.731961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e09ec-507d-4ffd-a938-9276abb18080 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.739174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.774005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.775134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.775614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.776016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] PATH_INFO: `/v3/users/1d43d5270088403f9439f03abe1427d9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.777380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] RBAC: Authorizing `identity:get_user(user_id=1d43d5270088403f9439f03abe1427d9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.778949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.785585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 161/315] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/users/1d43d5270088403f9439f03abe1427d9 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:51.786603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.819757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:51.825841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f7e69-0862-4e84-b76e-52db62c6ab0d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.869204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.870366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.870836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.871265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.872659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.874286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.876469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 155/316] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:51.882986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:51.908291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280077a-52df-4a5b-afc7-76f84d09c608 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:51.957474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:51.959252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:51.959723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:51.960417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] PATH_INFO: `/v3/system/users/1d43d5270088403f9439f03abe1427d9/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:51.962657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1d43d5270088403f9439f03abe1427d9, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:51.964502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b55a6d-b3b1-422b-9754-9457b294e83c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:51.978291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 162/317] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jul 7 03:50:51 2022] PUT /identity/v3/system/users/1d43d5270088403f9439f03abe1427d9/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:52.018289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a4a12-b0f8-4905-8e4a-ce83c23bd6ce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:52.021676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:52.061178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:52.062211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:52.062678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:52.063136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:52.064245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb, user.id=aa608560814548b2bc70e44816fa8071) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:52.064808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:52.066769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3a541-3a14-4636-b733-8fc872f12284 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:52.074602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 156/318] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:50:51 2022] GET /identity/v3/role_assignments?user.id=aa608560814548b2bc70e44816fa8071&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=af7440c704bf475ea053f7f233a318ad => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:52.733998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9d1a-cfac-4347-a198-820a4cd91504 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:52.734538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9d1a-cfac-4347-a198-820a4cd91504 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:52.734538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b9d1a-cfac-4347-a198-820a4cd91504 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:52.735889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 163/319] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:52.741077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:52.741497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:52.741684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:52.758296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:52.759478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:52.828845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:52.851480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9d1a-cfac-4347-a198-820a4cd91504 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:52.947983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:52.960512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b9d1a-cfac-4347-a198-820a4cd91504 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:52.995176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:52.995903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:52.996203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:52.996474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:52.997618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:52.999056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404f633-d2b4-48f9-b129-2444d49859fb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:53.000866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 164/321] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:53.006327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:53.099782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4354a-3d28-4dcb-b0ee-eb07144e9ad6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.100110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4354a-3d28-4dcb-b0ee-eb07144e9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.100356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4354a-3d28-4dcb-b0ee-eb07144e9ad6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.102343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 165/322] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:53.107549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.108402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.108822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.110157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:53.113943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb7817a-c378-4a6b-832f-a2874a789f70 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:53.126760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:53.127931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:53.154596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:53.155314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.155592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.155864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] PATH_INFO: `/v3/groups` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.156583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:53.158029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:53.173812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 158/323] 10.222.0.26 () {60 vars in 1134 bytes} [Thu Jul 7 03:50:53 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:50:53.200591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 166/324] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:53.223033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:53.335527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787e33f-3dbd-450a-8f3e-b4d03d013bbe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:53.371411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:53.372580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.372848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.373110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.383414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:53.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:53.391929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:53.392748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 159/325] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:53.398355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:53.495333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:53.506944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b841e3b-09a4-4a10-9292-4332a5204626 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:53.544110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:53.544825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.545098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.545365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.546121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:53.546424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:53.547803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:53.557094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 167/326] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:53.562533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:53.582972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:53.672744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53e526-b02b-4854-953d-0d63b81f8faa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:53.708343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:53.709618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.710104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.710557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] PATH_INFO: `/v3/users/41725b7abf1f47d5bff0f39e59859b95` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.714024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] RBAC: Authorizing `identity:get_user(user_id=41725b7abf1f47d5bff0f39e59859b95)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:53.716146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76757-0eb6-4c85-8645-e9dca271522d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:53.718347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 160/327] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:53 2022] GET /identity/v3/users/41725b7abf1f47d5bff0f39e59859b95 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:53.723713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:53.828262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de568b-791e-46a4-a1af-5a68e40e91b2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:53.862596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:53.863471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:53.863732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:53.863995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] PATH_INFO: `/v3/system/users/41725b7abf1f47d5bff0f39e59859b95/roles/af7440c704bf475ea053f7f233a318ad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:53.865512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=41725b7abf1f47d5bff0f39e59859b95, role_id=af7440c704bf475ea053f7f233a318ad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:53.866878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceda472a-623f-468b-b258-1c82ae25265c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:53.877516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 168/328] 10.222.0.26 () {58 vars in 1334 bytes} [Thu Jul 7 03:50:53 2022] PUT /identity/v3/system/users/41725b7abf1f47d5bff0f39e59859b95/roles/af7440c704bf475ea053f7f233a318ad => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:50:54.021491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b919-43f1-4c74-9fbc-608c22f1eb81 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.021998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b919-43f1-4c74-9fbc-608c22f1eb81 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.021998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96b919-43f1-4c74-9fbc-608c22f1eb81 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.023423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 161/329] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:54.029558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.029995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.030371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.053702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:54.054893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:54.066711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:54.126474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 169/330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:54.149928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96b919-43f1-4c74-9fbc-608c22f1eb81 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:54.255555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:54.275566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96b919-43f1-4c74-9fbc-608c22f1eb81 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:54.313623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:54.314438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.314720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.315038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.326118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:54.334032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:54.336010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:54.338100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:54.339527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 162/331] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:54.344158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:54.448929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57421044-c679-4fe0-95f5-a7fe8096f4d5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:54.496436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:54.497414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.497906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.498317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.499219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:54.499663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:54.501212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:54.515597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 170/332] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:54.521573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:54.656956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109ae69-b83a-452b-a9d2-483f4fb4622f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:54.692440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:54.693349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.693624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.693892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] PATH_INFO: `/v3/users/1d43d5270088403f9439f03abe1427d9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.695135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] RBAC: Authorizing `identity:get_user(user_id=1d43d5270088403f9439f03abe1427d9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:54.696639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9927cb-c748-4238-8628-2dc66b61968c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:54.698607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 163/333] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:54 2022] GET /identity/v3/users/1d43d5270088403f9439f03abe1427d9 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:54.704917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:54.740551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:54.847014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7f8ec-da34-4c7f-a0d5-e7bddd2ff1a5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:54.887578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:54.888308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:54.888585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:54.888851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:54.889696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] RBAC: Adding query filter params (role.id=53143fe8892742cda2ef02e845ce54f2, user.id=1d43d5270088403f9439f03abe1427d9, scope.system=all) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:54.890000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:54.891431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be6d02-60ed-40ea-a5df-fa916f319c29 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:54.903934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 171/334] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jul 7 03:50:54 2022] GET /identity/v3/role_assignments?user.id=1d43d5270088403f9439f03abe1427d9&scope.system=all&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:55.604207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434e67-48d8-4907-998f-0227e1a032bd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:55.604207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434e67-48d8-4907-998f-0227e1a032bd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:55.604207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75434e67-48d8-4907-998f-0227e1a032bd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:55.605370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 164/335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:55.609475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:55.610001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:55.610475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:55.630547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:55.632051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:55.702271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:55.711349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 172/336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:55.745410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434e67-48d8-4907-998f-0227e1a032bd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:55.762539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:55.859151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75434e67-48d8-4907-998f-0227e1a032bd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:55.897056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:55.898240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:55.898715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:55.899187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:55.910787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:55.919026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:55.919895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:55.920728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:55.925346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 165/337] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:55.928932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.058268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdbeb5-9a53-4cd1-a5d7-ca6481295f99 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:56.100860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:56.101553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.101839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.102110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.102878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:56.103184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:56.104658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49c091-3f80-4355-8c49-29b690a3cf52 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:56.113880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 173/338] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:56.120012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.168138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70acc-019e-45f3-bdf0-a3cc37d0f998 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.168468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70acc-019e-45f3-bdf0-a3cc37d0f998 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.168692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da70acc-019e-45f3-bdf0-a3cc37d0f998 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.170381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 174/339] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:56.175431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.175710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.175987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.203991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:56.205536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:56.221083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:56.244827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bb138-26d1-41c7-9725-58636a64617f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:56.284364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:56.285040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.285320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.285596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.336157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:56.359837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:56.361373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:56.387791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 175/340] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:50:56.429200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.440518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:56.466747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 166/341] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:56.472312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.587097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1defbe54-0f71-4d21-9714-cd233cfaba0a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:56.637324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:56.638334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.638798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.639579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.644237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:56.646209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:56.648843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 167/342] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:56.654040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.729464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81527d45-bf8d-4acb-a6d5-88b634d3f41e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:56.736483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:56.782616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:56.783602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.783997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.784387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.800028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:56.804346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17808c6a-3f66-4a03-81fb-e0c29f6abff3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:56.812785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:56.813678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:56.814477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 176/343] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:56.820083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:56.872147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:56.872147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:56.872147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:56.872147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:56.888907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:56.890366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:56.892491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 168/344] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:56.896465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:56.901401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.005876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c89a8f-dd07-4a69-88db-e03668b97a38 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.051288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50498a8-40b5-4faa-8b7f-27f1f955984b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.058717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.059404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.059681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.059951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.060740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:57.061040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.062674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948ce53-9d52-40db-b65d-bdfc358593e8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.071673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 177/345] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:57.073094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990053-6cc8-46b3-a587-70b28f501d89 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.073378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990053-6cc8-46b3-a587-70b28f501d89 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.073650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990053-6cc8-46b3-a587-70b28f501d89 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.075109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 178/346] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:57.081141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990053-6cc8-46b3-a587-70b28f501d89 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.088466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.100580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.101282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.101674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.101951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.102807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=999a433fcf7c4842aac17941a0a4aa89) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:57.103118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.104682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431000fc-35f3-46e4-8b58-d3d86e8aba9d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.123038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 169/347] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:50:56 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 260 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:57.124399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4bff-e6bb-4416-bce9-0a245a370fc5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.125114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4bff-e6bb-4416-bce9-0a245a370fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.125395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a4bff-e6bb-4416-bce9-0a245a370fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.161430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7f1a4bff-e6bb-4416-bce9-0a245a370fc5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:57.162580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7f1a4bff-e6bb-4416-bce9-0a245a370fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:57.243844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990053-6cc8-46b3-a587-70b28f501d89 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.248018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 170/348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:57.253547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbafbb-4049-4f15-8d47-8f3724a4e280 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.253833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbafbb-4049-4f15-8d47-8f3724a4e280 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.254103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbafbb-4049-4f15-8d47-8f3724a4e280 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.255431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 171/349] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:57.275398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.276702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.276984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.277251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.289901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.291346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.291731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.292106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.297146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:57.298347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:57.386396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 172/350] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:57.387266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.394564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.396063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.420315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.500268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d06fb-39ce-4e61-8a60-291cd7300c1b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.523514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 179/351] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:57.524410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.536706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.542439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.543286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.543560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.543825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.558241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:57.573748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:57.574908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 07 03:50:57.575924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:50:57.577616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 173/352] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:57.578497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.661881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b1776-9131-4a3d-9445-c5c516e7e94f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.704563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.710429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.711614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.711990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.712423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.712876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8097fa0c-bfeb-4a03-813b-4674d7db09af None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.725942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:57.736303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:57.737215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:57.738025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 180/353] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:57.738654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.763187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.764237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.764525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.764965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.766487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.767969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.770685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 174/354] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:57.771483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.822302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:57.859013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488275b3-5a48-4a59-81b5-34e9ce6b7df4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.904366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39871ea5-b6d6-4b42-a38c-b8a3cff70840 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:57.904558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.904558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.904558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.904558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.905424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:57.905764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.908289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.923146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 181/355] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:57.924009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:57.950731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:57.951419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.951697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.951969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.952778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:57.953080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:57.954462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ca53c-f3be-4356-b766-e2bf3b6df29c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:57.964177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 175/356] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:57.967077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f7c2-bd15-44cc-bbe5-b514888854af None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:57.967555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f7c2-bd15-44cc-bbe5-b514888854af None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:57.968038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70f7c2-bd15-44cc-bbe5-b514888854af None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:57.969488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 176/357] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:50:57.971089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f7c2-bd15-44cc-bbe5-b514888854af None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.000557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.058665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f4460-b947-4e0c-b7e7-6668a76a0541 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.089128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70f7c2-bd15-44cc-bbe5-b514888854af None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.095602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.101897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.102786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.108318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.108318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.108318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.109378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.114272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 182/358] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:58.115082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.143006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.144414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.144887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.145344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] PATH_INFO: `/v3/users/41725b7abf1f47d5bff0f39e59859b95` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.146917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] RBAC: Authorizing `identity:get_user(user_id=41725b7abf1f47d5bff0f39e59859b95)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.149803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e781b8d3-f778-43e7-aa03-1f1b81d5eb59 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.152152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 177/359] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:50:57 2022] GET /identity/v3/users/41725b7abf1f47d5bff0f39e59859b95 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:58.153629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.154099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.154567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.173865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:58.175479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:58.255370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c72fd3-125a-4df4-95cb-0daf75046bdf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.276581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 178/360] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:58.277531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.301528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.319063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.320089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.320622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.321094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.402306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad1bc8-c941-423a-97c3-4f9f9db0966a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.403486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.407657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.409169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.443600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.444675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.445169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.445635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.446668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:58.447212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.448904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.454774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 179/361] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:58.455814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.537782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 183/362] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:58.538768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.549254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.570205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cd397b-2b87-4d63-9427-a8d3d81b1f74 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.610672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.611711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.612224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.612759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.613866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] RBAC: Adding query filter params (role.id=af7440c704bf475ea053f7f233a318ad, user.id=41725b7abf1f47d5bff0f39e59859b95, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:58.614386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.616054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.629431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 180/363] 10.222.0.26 () {56 vars in 1308 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/role_assignments?user.id=41725b7abf1f47d5bff0f39e59859b95&scope.system=all&role.id=af7440c704bf475ea053f7f233a318ad => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:58.630824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.668527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa656-0423-4882-9687-6559a1a309d5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.672129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.731392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.733052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.733052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.733052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.760863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:58.771287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5f7a9-14cd-4fc2-b2f0-adf622824188 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:58.777586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:58.778592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:50:58.779416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:58.786820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 184/364] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:58.809667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.841502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.842416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.842699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.842976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.849179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:58.850710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d497d-096a-4892-a008-b11c55c47327 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:58.852897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 181/365] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:58.856739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39505-eea7-4265-a5a1-9b3f49f33ea7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.857040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39505-eea7-4265-a5a1-9b3f49f33ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.857297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39505-eea7-4265-a5a1-9b3f49f33ea7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.859815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 182/366] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:50:58.862989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a39505-eea7-4265-a5a1-9b3f49f33ea7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:58.877148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:58.951443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d53130-fcb8-47d2-9572-4925234fa02b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.979603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a39505-eea7-4265-a5a1-9b3f49f33ea7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:58.994887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:58.995910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:58.996450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:58.996909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:58.997938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:58.998440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.000075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30b32c-5fef-4e10-ae8e-d2bbe491b4a8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.010408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 185/367] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:59.016155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.016780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.017313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.020060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.020961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.021248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.021520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.022725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.024798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.032703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 183/368] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:50:58 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:59.033269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.038776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:50:59.040258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:50:59.062781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.134775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.138206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 186/369] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:50:59.139212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.163732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69fd34c-9a99-4543-b4a1-52275b808969 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.206335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.207428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.207710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.208309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.280296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1c418-922b-4010-8ec7-fcb5342ef43b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.311055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.313063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.330102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.330809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.331089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.331362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.332712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=eb2c11a2e5d746399d51600c61e729bb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:59.333034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.334488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.340967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 187/370] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:59.349150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.381537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.403342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.430242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 184/371] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:50:59.435647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.563586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a593b-b21f-46fb-b7ca-3bcf216890ab None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.578641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2b277-f68f-484d-8604-cd7c79b0ca16 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.618689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.620040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.620516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.620943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.622619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.624464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.626727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 185/372] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:59.632046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.632273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.633137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.633377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.633640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.657675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:50:59.674916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:50:59.676030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:50:59.676927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 188/373] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:50:59.681792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.684484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.740768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39ba2-dca2-4107-a867-defc6467d813 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.776765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.778350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.778829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.779281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.780683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.782321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.784483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 186/374] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:50:59.786165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:50:59.793948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.824707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07ba0b-81dd-46c6-b1c7-9910f712482c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:50:59.883779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:50:59.884552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:50:59.884834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:50:59.885105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:50:59.885870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:50:59.886174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:50:59.887548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:50:59.906683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 189/375] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:50:59.910679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:50:59.997583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db50c64-955e-44ce-ab15-f2d5b62da9be None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.016153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.040614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.041733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.042217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.042692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.043880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:00.044421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.046241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47113e4-9764-4df5-bbcd-89268cbb4043 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.055169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 187/376] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 260 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:00.056893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd134a-925b-42c4-90dd-3f659f3f46a6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.057403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd134a-925b-42c4-90dd-3f659f3f46a6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.057955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd134a-925b-42c4-90dd-3f659f3f46a6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.059807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 188/377] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:00.066578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.067160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.067684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.078660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d296425-d7ee-4555-ad07-b2cc21941a0b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.086826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:00.088506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:00.170121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.170876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.171157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.171433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.173122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 189/378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:00.182846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.200769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.280146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.281711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.316357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda4136-bc1d-4dfb-aac1-7db40b351d2f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.325411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.358290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.359440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.360052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.360554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.372261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:00.381081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:00.381953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:00.382734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:00.385570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 190/379] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:00.391363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.431877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 190/380] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:00.445134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.506537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.512176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e30e9-d998-4c3a-833b-494953c810b9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.552771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.553458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.553739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.554008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.554771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:00.555072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.556568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.578415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 191/381] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:00.584973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.634121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5e77d-1f18-4efd-b6f1-e64047d9c89b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.642618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.702850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.703732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.704010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.704309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] PATH_INFO: `/v3/projects/43ba045a853249cf8b4e900b21790d5d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.708631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=43ba045a853249cf8b4e900b21790d5d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.710097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.715779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 191/382] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/projects/43ba045a853249cf8b4e900b21790d5d => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:00.721136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.760611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541f15f-e78f-496c-a8fd-7acd3eee37de None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.813940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.814829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.815111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.815384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.816681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.818140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.820424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 192/383] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:00.825584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:00.870791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1116-abb4-4737-9948-bc5a88ab2fa9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.892553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.944389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:00.945278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:00.946157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:00.946597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:00.947107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] PATH_INFO: `/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:00.960923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] RBAC: Authorizing `identity:get_group(group_id=8ad33bdb678d4c8cb0e517c9a75ee197)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:00.961180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad048c0b-2e19-46ef-b8b3-033fd850f9d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:00.964388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:00.966722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 192/384] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197 => generated 229 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:00.987409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:01.018640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:01.019523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.019795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.020066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.021417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:01.022874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:01.024929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 193/385] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:01.030487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:01.159028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c50a-4966-4c86-bbcb-af3d2433ddd0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:01.203859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:01.204774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.205043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.205309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/groups/8c42b5042c09413ca05b86025cd7af11/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.207825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20587b2-cc01-466f-8b61-52d10f53e6ac None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:01.213687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, group_id=8c42b5042c09413ca05b86025cd7af11, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:01.215468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a80d9d-5439-4050-b5b1-974bcec23205 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:01.236822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 194/386] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jul 7 03:51:01 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/groups/8c42b5042c09413ca05b86025cd7af11/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 03:51:01.238197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8de9-b051-4d99-bfc3-bb5a9a30629d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.238479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8de9-b051-4d99-bfc3-bb5a9a30629d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.238750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c8de9-b051-4d99-bfc3-bb5a9a30629d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.240101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 195/387] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:01.248827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:01.249524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.249806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.250081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.250957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] RBAC: Adding query filter params (group.id=8ad33bdb678d4c8cb0e517c9a75ee197, role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=43ba045a853249cf8b4e900b21790d5d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:01.251275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:01.252871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:01.258194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.258522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.258739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.262630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 193/388] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:00 2022] GET /identity/v3/role_assignments?group.id=8ad33bdb678d4c8cb0e517c9a75ee197&scope.project.id=43ba045a853249cf8b4e900b21790d5d&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:01.290322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:01.291667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:01.323818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:01.401877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 196/389] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:01.444588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:01.483187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:01.564564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8abf9-0d3f-44ed-896d-b6197ce0190f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:01.608228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:01.609236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.609519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.609794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.622565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:01.632672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:01.633600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:01.634960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 194/390] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:01.640611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:01.781020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20554b6-17eb-4734-beec-a37f993a97e6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:01.828437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:01.830716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:01.831505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:01.832352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:01.833942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:01.834683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:01.837207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad844f4-b1c2-4d4a-86b2-d54d78fadbf1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:01.849562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 197/391] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:01.854802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:01.996605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:02.004724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612e5f0-33e1-46e5-bbc7-04dd7e994b82 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.036045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37cd-4292-4ebe-b249-e1dcc2ffdbfe None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.036684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37cd-4292-4ebe-b249-e1dcc2ffdbfe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.037169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc37cd-4292-4ebe-b249-e1dcc2ffdbfe None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.038775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 198/392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:02.044196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.044425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.044919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.045300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.045577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.045789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.045884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.047117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:02.051317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:02.052608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 195/393] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:01 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:02.056417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:02.081207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:02.082768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:02.105622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:02.169326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930a908-151e-4ebe-a729-7e6044ce7302 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.217048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.217953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.218228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.218499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.219938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:02.221423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:02.228853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 196/394] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:02 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:02.234304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:02.252379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 199/395] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:02.274679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:02.287166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:02.396838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43c5f-44e2-4989-af7a-a057000dcd66 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.435292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.438420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.438730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.439008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89/groups/8c42b5042c09413ca05b86025cd7af11/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.441545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=999a433fcf7c4842aac17941a0a4aa89, group_id=8c42b5042c09413ca05b86025cd7af11, role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:02.443121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:02.461576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca59f-a7c1-42f3-a2e7-f3d89bef0559 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.467431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jul 7 03:51:02 2022] PUT /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89/groups/8c42b5042c09413ca05b86025cd7af11/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:02.508284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.509622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.510133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.510624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.524907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:02.533719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:02.534661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:02.535494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:02.539077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 200/397] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:02.544400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:02.699015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:02.712108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95826f-8a28-455d-ac2f-49c11b4638c5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.756084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.756834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.757111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.757382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.758124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:02.758425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:02.759793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:02.770197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 198/398] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:51:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:02.776171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:02.788719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:02.907621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab0a0-5b95-4a85-865a-429cae1aa6eb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:02.945895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:02.946814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:02.947146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:02.947426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:02.948730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:02.950288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:02.952148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 201/399] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:02 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:02.957835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:03.107290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a8ecd-cfde-4a71-989f-f3b96451aa0f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:03.151970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:03.153302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.153797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.154270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.159292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:03.160996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ba72bc-6bcf-480e-8352-4fd55059ed19 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:03.162971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 199/400] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:02 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:03.169199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:03.222688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d1c5-0f92-4b7d-98cb-67f3a1f209aa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.223717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d1c5-0f92-4b7d-98cb-67f3a1f209aa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.224277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5d1c5-0f92-4b7d-98cb-67f3a1f209aa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.227286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 200/401] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:03.232412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.233023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.233511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.264807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:03.266675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:03.268292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:03.291683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102832-c8e9-45b5-b7d5-27759ed16983 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:03.296483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:03.326893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:03.327799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.328074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.328377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/groups/8c42b5042c09413ca05b86025cd7af11/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.330376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, group_id=8c42b5042c09413ca05b86025cd7af11, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:03.331824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:03.351665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 202/402] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jul 7 03:51:03 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/groups/8c42b5042c09413ca05b86025cd7af11/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:03.392770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 201/403] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:03.420552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:03.541217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188bf2b-23f1-40cc-ac4d-6204a6779adc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:03.577279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:03.578108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.578380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.578646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.580691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:03.591748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e1476b27-ebcd-4ef3-8d9f-87ddb06873e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:03.602458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:03.603652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:03.604673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:03.607311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 203/404] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:03.614436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:03.721830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6c31-6bcc-4e58-a56c-45639bf6908d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.722101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6c31-6bcc-4e58-a56c-45639bf6908d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.722439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a6c31-6bcc-4e58-a56c-45639bf6908d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.723964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 204/405] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:03.729616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.729974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.730302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.732431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd794355-57e7-4193-819e-7f255910cce6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:03.749892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:03.751175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:03.793519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:03.794398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:03.794682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:03.795314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:03.796399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:03.796712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:03.798214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:03.818368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 202/406] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:03.824385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:03.851571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:03.855957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:03.882168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.012085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcbef2-872c-4ce5-aab5-63dfe67a5fde None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.048815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3beceff-7f8a-4cf6-8c2c-667df1acbeeb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.061159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.062067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.062345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.062618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.063851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.065347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.067565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 203/408] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:03 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:04.073268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.085365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.100885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.101700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.102170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.102443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.114661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a6b96afb-7107-42b4-ae8d-fcc9c0db6563 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:04.122971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:04.123859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:04.124702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:04.125334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 206/409] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:04.126532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299902-9e1a-4021-b5a7-147478173969 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.126703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299902-9e1a-4021-b5a7-147478173969 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.128153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c299902-9e1a-4021-b5a7-147478173969 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.128574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 207/410] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:04.131395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299902-9e1a-4021-b5a7-147478173969 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.199071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.221974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c9644-4e52-441e-a454-4ca4df3f3219 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.257280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.258158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.258282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c299902-9e1a-4021-b5a7-147478173969 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.258454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.258693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.259930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.261590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a30c2-3ca4-46e3-9ae9-275cdd2d5b9e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.264590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 204/411] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:04.265830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.266115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.266393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.284570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:04.285777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:04.300015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.301296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.301768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.302468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.303934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:04.304718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.306973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.318564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 208/412] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:04.320245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.369244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 205/413] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:04.372411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.387893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.450099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce79d3-b038-4073-81f5-ff51e3911cee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.475047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.492714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.494288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.494776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.495233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb/groups/8c42b5042c09413ca05b86025cd7af11/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.498967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb2c11a2e5d746399d51600c61e729bb, group_id=8c42b5042c09413ca05b86025cd7af11, role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.500953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.501544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba9d0e4-be94-41c8-bd5f-84f720728ef4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.528177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 209/414] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jul 7 03:51:04 2022] PUT /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb/groups/8c42b5042c09413ca05b86025cd7af11/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:04.528790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.557682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.559181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.559875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.560362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] PATH_INFO: `/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.562214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] RBAC: Authorizing `identity:get_group(group_id=8ad33bdb678d4c8cb0e517c9a75ee197)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.564509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.566941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 206/415] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:04.576447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.697066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f883d3-bc85-466b-b98f-13141012bc96 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.708772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.757418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.758741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.759573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.760043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.773939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:04.779379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d2eaed-a7a6-458f-aef4-51748347563d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:04.784233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:04.785100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:04.785878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:04.789000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 210/416] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:04.794740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.825248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658094-167e-486c-91a4-668218540ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.826127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658094-167e-486c-91a4-668218540ddf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.826408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658094-167e-486c-91a4-668218540ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.826677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff658094-167e-486c-91a4-668218540ddf None admin] PATH_INFO: `/v3/projects/43ba045a853249cf8b4e900b21790d5d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.829015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658094-167e-486c-91a4-668218540ddf None admin] RBAC: Authorizing `identity:get_project(project_id=43ba045a853249cf8b4e900b21790d5d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.830531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff658094-167e-486c-91a4-668218540ddf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.832804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 207/417] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/projects/43ba045a853249cf8b4e900b21790d5d => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:04.838268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658094-167e-486c-91a4-668218540ddf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:04.872522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:04.922159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf91519-9e3e-408a-ab1c-e0a953751555 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.954449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff658094-167e-486c-91a4-668218540ddf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:04.968041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:04.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:04.969593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:04.970089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:04.971169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:04.971670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:04.973388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:04.984000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 211/418] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:04.989932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.006051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.007282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.007757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.008238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] PATH_INFO: `/v3/projects/43ba045a853249cf8b4e900b21790d5d/groups/8ad33bdb678d4c8cb0e517c9a75ee197/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.012795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=43ba045a853249cf8b4e900b21790d5d, group_id=8ad33bdb678d4c8cb0e517c9a75ee197, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:05.014465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870fc3f8-730f-4f7d-9c64-484b7ea08d4e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:05.038805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 208/419] 10.222.0.26 () {58 vars in 1442 bytes} [Thu Jul 7 03:51:04 2022] PUT /identity/v3/projects/43ba045a853249cf8b4e900b21790d5d/groups/8ad33bdb678d4c8cb0e517c9a75ee197/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 03:51:05.044625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:05.126521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b036c-bea0-49cb-8e21-d8f65d91265e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:05.167440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598135a0-883a-4667-875c-caa11969e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.168112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598135a0-883a-4667-875c-caa11969e425 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.168428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598135a0-883a-4667-875c-caa11969e425 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.168697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598135a0-883a-4667-875c-caa11969e425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.243005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598135a0-883a-4667-875c-caa11969e425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:05.244651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598135a0-883a-4667-875c-caa11969e425 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:05.273916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:05.287576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176220-70a1-4c6c-98d7-5075e11de1a1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.288596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176220-70a1-4c6c-98d7-5075e11de1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.289189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d176220-70a1-4c6c-98d7-5075e11de1a1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.291226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 209/420] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:05.297030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d325b2-c154-4a44-bded-0371869c952e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.297598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d325b2-c154-4a44-bded-0371869c952e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.298063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d325b2-c154-4a44-bded-0371869c952e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.316021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-48d325b2-c154-4a44-bded-0371869c952e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:05.318154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-48d325b2-c154-4a44-bded-0371869c952e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:05.369814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 212/421] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:05.377885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598135a0-883a-4667-875c-caa11969e425 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.414892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 210/422] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:05.439105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d325b2-c154-4a44-bded-0371869c952e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.442603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:05.489560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598135a0-883a-4667-875c-caa11969e425 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:05.517360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:05.526691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.527851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.528367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.528810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.530182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:05.531824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:05.534109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 213/423] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:05.539132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.572104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d325b2-c154-4a44-bded-0371869c952e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:05.616324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.617529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.618043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.618517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.634942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:05.648268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:05.649252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:05.650221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:05.661596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 211/424] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:05.665910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.749444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987ac26-18a8-47de-ada0-b00f236767f9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:05.789328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:05.817062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.819201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.820146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.821276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.824396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:05.827018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:05.831499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 214/425] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:05.836191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.856108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbedc0e2-5372-4681-8f73-cb162c282880 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:05.919250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:05.920331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:05.920839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:05.921304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:05.922255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:05.922749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:05.925792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:05.950541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 212/426] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:05.961142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:05.968629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.009629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2530e-bc1a-40c8-9fde-38443a858e8a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.057159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.057855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.058164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.058999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.059861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=999a433fcf7c4842aac17941a0a4aa89) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:06.060203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.062166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bea89a-d1d1-46a1-8a77-0a2391ccfa61 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.071078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 215/427] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:06.076641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3419-4090-4912-a3de-ed789c138e77 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.077205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3419-4090-4912-a3de-ed789c138e77 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.077722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe3419-4090-4912-a3de-ed789c138e77 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.085171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 216/428] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:06.087211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.089305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.090926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.111370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a47d2-c64b-447b-9ede-1e48e207fdee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.121235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:06.122480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:06.171080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.207862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 217/429] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:06.209971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.210658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.210941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.211296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.255395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.322231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.324372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.349340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.404502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e55fe8-4508-4bdf-a735-b6a90813d992 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.443255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.444444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.444924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.445416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.458562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 213/430] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:06.461147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.465098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:06.473373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:06.474245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 07 03:51:06.475035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:06.477736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 218/431] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:06.483614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.491064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.575570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175ede1-05f4-4d1b-969f-e81565f3cede None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.591776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8426bdd-8ef2-415a-b425-e05a549c1529 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.618334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.626375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.627269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.627548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.627820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] PATH_INFO: `/v3/projects/999a433fcf7c4842aac17941a0a4aa89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.629124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] RBAC: Authorizing `identity:get_project(project_id=999a433fcf7c4842aac17941a0a4aa89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.630669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.632753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 214/432] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/projects/999a433fcf7c4842aac17941a0a4aa89 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:06.641159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.643378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416064-2152-4704-9008-89084f55fada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.644049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416064-2152-4704-9008-89084f55fada None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.644462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416064-2152-4704-9008-89084f55fada None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.644732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63416064-2152-4704-9008-89084f55fada None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.645652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63416064-2152-4704-9008-89084f55fada None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:06.645994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63416064-2152-4704-9008-89084f55fada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.647756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63416064-2152-4704-9008-89084f55fada None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.657560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 219/433] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:06.665095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416064-2152-4704-9008-89084f55fada None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.761658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.769359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc079901-5218-4e3e-a98f-d18a93c45189 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.812987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.814027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.814399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.814769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.816154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.817615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.819772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 215/434] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:06.820258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63416064-2152-4704-9008-89084f55fada None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.825535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:06.864274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:06.866082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:06.866513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:06.866913 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:06.934237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:06.954708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a00c2-c441-4861-a790-9f9e83393506 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:06.960608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:06.962254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:06.999733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.000991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.001442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.001871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.004176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=999a433fcf7c4842aac17941a0a4aa89) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:07.004638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.006532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828841c-6893-4013-a0e8-870b2cfb1038 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.015803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 216/435] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=999a433fcf7c4842aac17941a0a4aa89&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:07.054607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cfad-b39b-4da4-94d0-8d468cd1333b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.055251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cfad-b39b-4da4-94d0-8d468cd1333b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.055744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996cfad-b39b-4da4-94d0-8d468cd1333b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.057809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 217/436] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:07.064690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773962c-1446-4b70-a02e-12c48138160b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.065588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773962c-1446-4b70-a02e-12c48138160b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.066329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773962c-1446-4b70-a02e-12c48138160b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.086613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d773962c-1446-4b70-a02e-12c48138160b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:07.088283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d773962c-1446-4b70-a02e-12c48138160b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:07.096099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 220/437] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:07.102170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.113259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.176145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 218/438] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:07.194081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773962c-1446-4b70-a02e-12c48138160b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.211205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.233405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a23b-9808-4380-b415-6586b5742a47 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.278646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.279915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.280453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.280791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.282078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.283540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.285408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 221/439] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:07.290829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.314750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773962c-1446-4b70-a02e-12c48138160b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.374173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.374845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.375089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.375309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.388573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:07.395131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:07.395983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:07.396812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:07.397435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 219/440] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:07.403965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.419580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cd2f1-deaa-4e8e-af33-43c091256363 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.428722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.471829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.472778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.473500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.473780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.475265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.476973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.479581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 222/441] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:07.485622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.507303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.533528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ea3d6-7e29-4189-ac4c-2f12d9a6e51d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.566731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.567394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.567667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.567933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.568708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:07.569009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.570380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53202e32-e2c6-4bf5-a0ee-56af08a06fb3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.578464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 220/442] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:07.579489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470454ae-0ad3-454b-8f62-462c092e9bbe None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.579765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470454ae-0ad3-454b-8f62-462c092e9bbe None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.580033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470454ae-0ad3-454b-8f62-462c092e9bbe None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.581300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 221/443] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:07.583826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470454ae-0ad3-454b-8f62-462c092e9bbe None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.602164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89877ba2-977d-45d0-8b91-4dd5c7501f24 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.634937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.635581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.635868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.636196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.637007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=53143fe8892742cda2ef02e845ce54f2, scope.project.id=eb2c11a2e5d746399d51600c61e729bb) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:07.637312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.638815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7642f-e7b5-44c6-8678-c6be92c4db0d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.644947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 223/444] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=53143fe8892742cda2ef02e845ce54f2 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:07.644947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.644947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.644947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.664088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:07.665341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:07.666185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.695345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470454ae-0ad3-454b-8f62-462c092e9bbe None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.735036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.736064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.736380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.736940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.740305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 224/445] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:07.763488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.775565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.824855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:07.826568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:07.879561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877d586-f506-4bd4-8e1f-cc44299b7d62 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:07.914440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:07.918726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:07.919543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:07.919884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:07.920177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:07.937007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:07.940369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 222/446] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:07.942907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:07.943806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:07.948818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 225/447] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:07.949475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:07.950569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.029078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.056272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b396d6c-3358-40f4-b085-0f229cb45bc1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.058697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34a5a5-0e16-436d-acb8-15d6282faf54 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.090487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.091338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.091498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.091636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.091868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] PATH_INFO: `/v3/projects/eb2c11a2e5d746399d51600c61e729bb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.092224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.092502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.092774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.093161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] RBAC: Authorizing `identity:get_project(project_id=eb2c11a2e5d746399d51600c61e729bb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.093524 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:08.093827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.094602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.095204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.096343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 223/448] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/projects/eb2c11a2e5d746399d51600c61e729bb => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:08.101820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.104529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 226/449] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:08.110617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.158548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.210920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c372c1f5-babe-4cd5-a675-f82e473f0333 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.216449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5840a-294b-4b2b-8499-5b490cac30f6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.244767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.247140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.248254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.248530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.248813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] PATH_INFO: `/v3/groups/8c42b5042c09413ca05b86025cd7af11` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.249982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] RBAC: Authorizing `identity:get_group(group_id=8c42b5042c09413ca05b86025cd7af11)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.250098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.250725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.251001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.251267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.251441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.253198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 224/450] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/groups/8c42b5042c09413ca05b86025cd7af11 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:08.259037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.320628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.322193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.357546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3ac70-59a7-42f6-9883-255727443b3d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.371292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.395250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.395901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.396201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.396469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.397311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] RBAC: Adding query filter params (group.id=8c42b5042c09413ca05b86025cd7af11, role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=eb2c11a2e5d746399d51600c61e729bb) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:08.397659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.399078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.405421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 225/451] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/role_assignments?group.id=8c42b5042c09413ca05b86025cd7af11&scope.project.id=eb2c11a2e5d746399d51600c61e729bb&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:08.419783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 227/452] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:08.425883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.533391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac6026-3fbc-486b-8241-a437c15ea0c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.570979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.571915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.572209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.572478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] PATH_INFO: `/v3/projects/43ba045a853249cf8b4e900b21790d5d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.573666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] RBAC: Authorizing `identity:get_project(project_id=43ba045a853249cf8b4e900b21790d5d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.575117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.577952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 226/453] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/projects/43ba045a853249cf8b4e900b21790d5d => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:08.582796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.617143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.688362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4fc2f-2328-41db-9b50-83d3a4aee732 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.721538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.722406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.722675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.722943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] PATH_INFO: `/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.724103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] RBAC: Authorizing `identity:get_group(group_id=8ad33bdb678d4c8cb0e517c9a75ee197)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.725572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ed03b-6645-4950-9bca-a306b9035692 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.727201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 228/454] 10.222.0.26 () {56 vars in 1180 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/groups/8ad33bdb678d4c8cb0e517c9a75ee197 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:08.733072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:08.778200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:08.836200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f730fb5-d051-4f1b-87f1-df2eee7622ba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:08.871106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:08.871744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:08.872026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:08.872320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:08.873161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] RBAC: Adding query filter params (group.id=8ad33bdb678d4c8cb0e517c9a75ee197, role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=43ba045a853249cf8b4e900b21790d5d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:08.873470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:08.874890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390f67-5c68-4fa7-bd73-d38a40da2713 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:08.880783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 227/455] 10.222.0.26 () {56 vars in 1376 bytes} [Thu Jul 7 03:51:08 2022] GET /identity/v3/role_assignments?group.id=8ad33bdb678d4c8cb0e517c9a75ee197&scope.project.id=43ba045a853249cf8b4e900b21790d5d&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:11.369201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd150b7-5c45-426c-a07b-c6dcb1bb799b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.369716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd150b7-5c45-426c-a07b-c6dcb1bb799b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.369791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd150b7-5c45-426c-a07b-c6dcb1bb799b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.371359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 229/456] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:11.376631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997c2c-06d5-46ce-9163-9e0f5c4fec52 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.377393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997c2c-06d5-46ce-9163-9e0f5c4fec52 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.377880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21997c2c-06d5-46ce-9163-9e0f5c4fec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.405729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-21997c2c-06d5-46ce-9163-9e0f5c4fec52 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:11.407287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-21997c2c-06d5-46ce-9163-9e0f5c4fec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:11.498738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 228/457] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:11.547558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd150b7-5c45-426c-a07b-c6dcb1bb799b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:11.600019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a6ed-6da4-4624-8819-f54bcb18e74a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.600320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a6ed-6da4-4624-8819-f54bcb18e74a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.600828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd46a6ed-6da4-4624-8819-f54bcb18e74a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.603791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 229/458] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:11.605144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a693-cf41-4edd-b0cb-764b4281348c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.605644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a693-cf41-4edd-b0cb-764b4281348c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.606109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78a693-cf41-4edd-b0cb-764b4281348c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.608329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 230/459] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:11.613203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e45d-32ec-4006-b9f1-2320c3ef60e9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.613864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e45d-32ec-4006-b9f1-2320c3ef60e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.614434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127e45d-32ec-4006-b9f1-2320c3ef60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.635554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1127e45d-32ec-4006-b9f1-2320c3ef60e9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:11.637068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1127e45d-32ec-4006-b9f1-2320c3ef60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:11.678199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:11.691703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:11.699256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd150b7-5c45-426c-a07b-c6dcb1bb799b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:11.722128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 231/460] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:11.723872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.724544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.725017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.741703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:11.743215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:11.763996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:11.765177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.766520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.766792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.781084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:11.783725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:11.808385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:11.809737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:11.811258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:11.811258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:11.811258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:11.811258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:11.818583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 230/461] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:11.818583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:11.835501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 232/462] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:11.837060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:11.951018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:11.955655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3f60b-ae7b-4acf-b1ed-ce2b93e09eb2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:11.960137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681377c-be41-4b35-9eda-bed440ad68b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:11.992188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:11.993175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:11.993503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:11.993781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:11.994784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:11.995097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:11.996651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.002565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.003617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.004494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.004772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.015395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 233/463] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:12.015395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.022694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.025095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:12.049127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:12.050019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:12.050834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:12.050834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:12.050834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.050834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:12.053022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 231/464] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:12.058083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.064631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.148048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4fe9b0-ed69-43e1-8c25-1dbc5c5a2d76 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.187261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f326ee0-f2a3-411b-8350-7f1f2730be65 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.191219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.191977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.192287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.192559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.206133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.207600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.222045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.222720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.223046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.223331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.224042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:12.225507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:12.226262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:12.227082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:12.227082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:12.227082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.227082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:12.227281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45987f-1617-4848-8546-07707deb1ea3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.227353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 234/465] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:12.227963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.245705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 232/466] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0b61-7acb-4097-b9f9-57fadebf8fbd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0b61-7acb-4097-b9f9-57fadebf8fbd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df0b61-7acb-4097-b9f9-57fadebf8fbd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 233/467] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:12.260080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0b61-7acb-4097-b9f9-57fadebf8fbd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.359481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3f80-887f-4e11-8266-7afaf50eb2c0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.361508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.402704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.403387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.403692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.403968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.404752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:12.405060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.406663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce32b9-e77d-4f5b-bee3-add104c4ddc4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.420877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 235/468] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:12.422806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df0b61-7acb-4097-b9f9-57fadebf8fbd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.425011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.425298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.425643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.445600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:12.446892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:12.474548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.475232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.475549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.475829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.476724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:12.477193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.478639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.497507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 234/469] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:12.498768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.527701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 236/470] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:12.529008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.533056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.638979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c142631-be3d-4718-a1c3-17d02981c65d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.656075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a49a3-86fc-4d6b-bda3-655a8d62b701 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.660258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.675482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.676187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.676477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.676743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.677459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.678927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.690688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.691362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.691641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.691915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.692657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.694104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd273d5-2c8f-42b1-a10e-22605136759c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.699319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 235/471] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:12.708597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.727486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 237/472] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/users => generated 248 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:12.729106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d12-1ca8-4d32-aeab-5ae97653ea79 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.729492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d12-1ca8-4d32-aeab-5ae97653ea79 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.729778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17d12-1ca8-4d32-aeab-5ae97653ea79 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.731103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 238/473] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:12.737014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.737296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.737625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.757742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:12.759257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:12.824619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:12.857076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20cf3b5-fb15-4687-a82b-9806a020ad76 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:12.858491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 239/474] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:12.918090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:12.919324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:12.919790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:12.920306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:12.936926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:12.937366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:12.939391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:12.963764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:12.964981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:12.965946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:12.965946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:12.965946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:12.965946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:12.965946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 236/475] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:12.972071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:13.003971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:13.089312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8980c-f952-450b-91f8-24ccf246e03c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:13.096162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468bd61-6e2c-4fa6-abe2-732a7f2ad560 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:13.133260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:13.133958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:13.134239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:13.134508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:13.135243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:13.135545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:13.136807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:13.136998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:13.137840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:13.138580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:13.139037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:13.140548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:13.142157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:13.150511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.sql.core [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 03:51:13.150511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 07 03:51:13.150511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [parameters: {'id': '521bd5610f2948fb939299c6e9ac16cc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 07 03:51:13.150511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 03:51:13.150883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 237/476] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:13.155672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 07 03:51:13.171287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return ref.to_dict() Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:51:13.172174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application yield resource Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise self.value Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application session.commit() Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 03:51:13.173047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.flush() Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application compat.raise_( Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 03:51:13.173874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:51:13.174733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:51:13.175537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [parameters: {'id': '521bd5610f2948fb939299c6e9ac16cc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:13.181808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 07 03:51:13.183201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.184780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 240/477] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jul 7 03:51:12 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:13.193433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:13.268483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:13.283593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2f70c-81fc-4549-a4c9-7a1ad25df9b7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:13.313676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:13.321957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:13.322934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:13.323423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:13.323892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:13.324816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:13.326699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:13.351777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 238/478] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:13 2022] POST /identity/v3/users => generated 249 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:13.407480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81ea39-0b64-4956-9928-a23326b9b980 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:13.457956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:13.459220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:13.459689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:13.460173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:13.472965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e26aa783-b3ab-447a-b22f-f4afc45080ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:13.481979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:13.482909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 07 03:51:13.483685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:13.488327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 241/479] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:13.497128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:13.608610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e62a01-67e6-40c2-8c11-d643254f606f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:13.645111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:13.646154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:13.646618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:13.647068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:13.648034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:13.648566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:13.650172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a524e741-1867-4842-ae64-4a1257c395b4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:13.659473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 239/480] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:14.612873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcfc-1b91-46bb-af65-d76473b127a6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:14.613932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcfc-1b91-46bb-af65-d76473b127a6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:14.614656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6edcfc-1b91-46bb-af65-d76473b127a6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:14.617041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 242/481] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:14.622334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:14.622754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:14.622922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:14.641972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:14.648919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:14.653476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:14.740844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 240/482] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:14.775618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edcfc-1b91-46bb-af65-d76473b127a6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:14.905450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6edcfc-1b91-46bb-af65-d76473b127a6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:14.923119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:14.967881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:14.968881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:14.969171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:14.969445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:14.985108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:14.992779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:14.993686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:14.994474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:14.998921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 243/483] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:15.001204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.163802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25627d9a-bc59-4475-9a06-a97db7a15f4b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.199480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.200183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.200468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.200733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.201490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:15.201792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:15.203552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6b4f-958f-428c-b0c9-db68e1135468 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:15.206044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:15.213257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 241/484] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:15.221901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.310860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079becc-7fe0-4707-848e-e1d728aa00ea None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.311246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079becc-7fe0-4707-848e-e1d728aa00ea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.311591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5079becc-7fe0-4707-848e-e1d728aa00ea None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.313514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 242/485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:15.320580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970195fc-0bff-4ba4-8526-7e1e8f755b17 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.320939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970195fc-0bff-4ba4-8526-7e1e8f755b17 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.321280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970195fc-0bff-4ba4-8526-7e1e8f755b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.346219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-970195fc-0bff-4ba4-8526-7e1e8f755b17 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:15.347505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-970195fc-0bff-4ba4-8526-7e1e8f755b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:15.387203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a69b3d-ee0e-4dd0-9901-17327b26c126 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.419501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 243/486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:15.420882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b897-161a-4507-b435-9665f5452267 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.421232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b897-161a-4507-b435-9665f5452267 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.421572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1b897-161a-4507-b435-9665f5452267 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.426930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 244/487] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:15.427043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.427043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.427043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.427043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.428616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.428889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.429153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.439841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:15.442618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:15.446556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:15.447897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:15.463862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:15.465060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:15.465871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:15.465871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:15.465871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:15.465871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:15.468374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 244/488] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:15.472164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.503986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:15.535764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 245/489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:15.536643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.591595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de3386-f8b6-403d-be1e-d8e12605574c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.625963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:15.626466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.626919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.627152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.627419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.640822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:15.650222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:15.651126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:15.651916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 245/490] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:15.652611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.684850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ad84d-00f6-4b6e-9e46-f1503ae4860d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.728067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.729155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.729631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.730348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.731926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:15.732586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:15.734564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:15.751050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 246/491] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:15.752189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.759311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:15.780233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b45ac-2b29-4540-8655-118cd4af66e9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.825505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.827332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.827788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.828510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.843965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:15.854867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:15.855813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:15.856639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:15.860438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 246/492] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:15.861485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.880839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad80cea-fa65-4c9e-8add-59cc46a8fcf6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:15.898899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:15.924180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:15.925471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:15.925950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:15.926619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:15.927963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:15.928587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:15.930175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:15.941868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 247/493] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:15.944266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:15.986891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27c15f-c07e-4d92-82e5-9f922f1c9ea9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.028200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.029822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.030250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.030664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.041770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.044207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.064260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817612b2-ac0c-4c29-96b0-fcb386e29f80 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:16.066062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:16.067125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:16.068267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:16.071182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 247/494] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:16.072289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.080190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.111355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.112037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.112354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.112630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.113392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:16.113697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.115416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.128157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 248/495] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:16.128157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.174807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.190541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944061e-c42e-4631-9eaf-78886a807363 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.225647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.226369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.226642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.226907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.235247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12f6e-148e-4afb-af32-2c08fff480d9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.237516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.238966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-80b5f319-b98d-4df8-9fdd-ec0fcbdd45d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:16.256233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:16.257100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:16.257917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:16.257917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:16.257917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:16.257917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:16.261933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 248/496] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:16.263173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807845-8999-460a-9e47-c8916758524b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.263427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807845-8999-460a-9e47-c8916758524b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.263702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807845-8999-460a-9e47-c8916758524b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.268912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 249/497] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:16.268912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807845-8999-460a-9e47-c8916758524b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.281322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.282452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.283312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.283832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.285120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:16.285814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.287821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.324787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.333217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 249/498] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:16.334083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.369721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807845-8999-460a-9e47-c8916758524b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.401625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.402423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.402719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.402989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.413250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.414702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.431014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b3d4bc01-f15b-4208-8565-ddb0602e1bcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:16.431561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:16.432541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:16.433531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:16.433531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:16.433531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:16.433531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:16.433531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 250/499] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:16.434083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.434373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.434634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.436678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb28d23-47c5-428d-b703-28a2d090ec8d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.450964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:16.452161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:16.473620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.474295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.474569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.474838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.475851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:16.476159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.477557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7f51e0-6b3e-4c8a-9599-807ab88fe1d5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 250/500] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141280a0-f270-46b9-b615-41b940ef3e33 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141280a0-f270-46b9-b615-41b940ef3e33 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141280a0-f270-46b9-b615-41b940ef3e33 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 251/501] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:16.495164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141280a0-f270-46b9-b615-41b940ef3e33 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.523244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 251/502] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:16.524111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.565231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.599905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141280a0-f270-46b9-b615-41b940ef3e33 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.625550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ab066-63f0-430e-9d4c-e660b64bb5c9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.633748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.634449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.634724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.634991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.658437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.659101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.659375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.659644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.660397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:16.660700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.662076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.662537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.673331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 252/503] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:16.677860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.708459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.710076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588e4ab-cc03-4a37-a198-f0b66d4f6dce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.768465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.772678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2397-abb8-48eb-8d9d-bec70209863f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.806208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 252/504] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:16.807311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.807810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.808328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.809963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.810898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.811022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.811302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.819339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:16.820858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:16.828739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:16.829975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:16.836089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:16.837125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:16.838140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:16.840257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 253/505] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:16.841513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.885942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:16.896833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 253/506] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:16.897651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:16.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c280781-9f55-4a2b-82ee-63ab023bdaf9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.988162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:16.988969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:16.989246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:16.989514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:16.995015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71970-8f42-4f91-97fb-44f81c99cf04 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:16.999390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:17.007006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:17.008085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 254/507] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:17.009150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.027281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.031450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.032317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.032600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.032875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.040099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.041587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:17.057200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:17.058303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 254/508] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:17.059328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.109638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.109802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac692e-2579-4e38-b5e0-b66196912b6a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.143159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.143967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.144278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.144566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.154930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.156430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.159043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d28c7-680a-433a-9ec3-17a092402d27 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:17.173160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:17.174146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:17.174965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:17.174965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:17.174965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.174965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:17.174965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 255/509] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:17.175236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.196003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.196729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.197002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.197271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.198109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:17.198403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.199836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.217478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 255/510] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:17.218418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.242829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.274732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dfd7c1-3aad-4796-8a27-445d626988e6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.306380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.307102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.307375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.307665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.316365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a2f0-97d9-411c-9e8d-668e95344c42 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.318572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.320022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.326036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:17.336954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:17.337807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:17.338625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:17.338625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:17.338625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.338625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:17.338625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 256/511] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:17.338930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.356794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.357460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.357734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.358000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.358766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:17.359066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.360478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.368404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 256/512] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:17.369214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.438010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8906-cea7-46a4-b962-b065e486e39c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.460868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.473695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.474364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.474640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.474908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.474994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba5a4b-e69e-48ce-8a3f-efdbaf108c14 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.475754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:17.476055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.477536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.508280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.508987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.509263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.509499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.510223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:17.510547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.511927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.517913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 257/513] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:17.517913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.524018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 257/514] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:17.524884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.556334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.616110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e8b9a-66d2-40ed-a1fe-8022165149ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.629047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1cf9f-4918-4be5-a052-bb10c6c11f16 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.649516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.650155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.650427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.650774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.662805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.663497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.663779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.664061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.664821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:17.665128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.666525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.677984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 258/515] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:17.678764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.701224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.721587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.723074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.770962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.781217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a098df-6e7a-444d-be0a-876971c4d1c2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.813224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.814026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.814306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.814577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.821036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 258/516] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:17.823008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.825817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.827281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:17.844479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:17.845457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 259/517] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:17.846478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:17.905240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:17.924499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bb5de-e71c-4321-aa24-6f2ce3095e16 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.945515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e792398-c915-43ab-ab4b-8f4ed810e462 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:17.959027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.959687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.960026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.960343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.978205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:17.979107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:17.979387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:17.979660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:17.986445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:17.987921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:18.002849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:18.003676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:18.004556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 260/518] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:18.005252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.007731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.030698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.032205 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.100958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4483f5-5411-471f-a73e-1e331f13c7c2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.108225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.129276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 259/519] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:18.130081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.136565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.137233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.137509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.137780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.138489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.139935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.160947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 261/520] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:18 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:18.161704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.237481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.237825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1c3e2f-099f-45b0-90da-0f3c4da52bee None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.278180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.279016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.279325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.279602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.283187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dac838-58b7-4f72-9eb4-db98f27a500a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.290742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.292301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:18.311315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:18.312258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:18.313083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:18.313083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:18.313083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:18.313083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:18.313083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 260/521] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:18.313591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.324853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.325570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.325801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.326066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.326800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:18.327100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.328547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.342428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 262/522] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:18.344857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.350803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.427340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbdef98-9345-48f3-ab43-3ad3fd0d1681 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.455663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd27d9-bb00-46ee-ae34-0bce9aeeaa39 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.462039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.462702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.462973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.463231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.464025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:18.464684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.466123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.474120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.485197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 261/523] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:18.486011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.497706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.498513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.498790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.499063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.512219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.514557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:18.533363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:18.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:18.535231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:18.535231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:18.535231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:18.535231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:18.535231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 263/524] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:18.535505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.589748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.599527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d23e280-93c1-43dc-9514-7e6257928058 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.635999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.636741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.636980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.637263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.638111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:18.638427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.639887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.648183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc936-849d-4521-90cd-a66648307bb1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.652162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 262/525] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:18.652496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.689212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.690651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.691086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.691494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.699719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.701406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:18.717057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:18.718165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:18.719358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:18.721369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 264/526] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:18.722299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.755741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.760537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b7554-bc92-4581-9b08-e79ccad61fdd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.794472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.795119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.795397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.795665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.796543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:18.796851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.798274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.803734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 263/527] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:18.804600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.826278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:18.844033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5021f-d388-4625-867e-3a069885f175 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.885467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.886160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.886483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.886756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.887589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:18.887805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.889286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.907743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 265/528] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:18.907743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:18.928532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5131846-bd5d-460c-bd9f-2965d7c63eec None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:18.967899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:18.969050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:18.969517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:18.969986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:18.977306 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:18.979103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:18.994240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:18.995111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:18.995969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:19.000094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 264/529] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:19.000956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.026045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.036674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6decc84-7ee2-4b49-8ab0-564b1ee005e1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.079007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.079804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.080079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.080376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.081532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.082531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:19.083002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.084794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.105076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 266/530] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jul 7 03:51:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:19.105488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf8a54-29b5-441f-a1ae-c217e41cb81b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.106269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.153126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.154208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.154625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.155038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.164189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.165904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:19.186387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:19.187424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:19.188479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:19.191452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 265/531] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:19.192445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.234434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbe9b7-89c4-4e4c-92b0-da7f39b16d36 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.276086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.276791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.277072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.277348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.278159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:19.278468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.280148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.303672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 267/532] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:19.304612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.320036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.322963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b695a5-b1e3-46ab-aea6-226570d13ea9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.365811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.366713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.367369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.368298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.372843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.426866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628219e-096b-4435-9ecd-818c5b767bb9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.457417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.459805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.466806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.467578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.467922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.468312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.469179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:19.469550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.471057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.483368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 268/533] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:19.484102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.559035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.586713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 266/534] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:19.587763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.604585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f6e5-380a-4dd0-99a6-3086c793345a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.622320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.641853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.642770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.643181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.643610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.644733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=f777aaf6bb714c8c949105aa8556c0bc) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:19.645180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.646923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.653465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 269/535] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/role_assignments?user.id=f777aaf6bb714c8c949105aa8556c0bc&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:19.654455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:19.692727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a70b9-59cf-409a-9901-86c4cf034ccf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.736177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.736177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.736177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.736177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.736637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=068cf00a56cc488586b207a13592f6e5) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:19.736637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.736637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.742072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 267/536] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/role_assignments?user.id=068cf00a56cc488586b207a13592f6e5&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:19.801751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75550eb-0502-41a7-8a89-54ea4f6d289b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:19.836479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:19.843085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:19.844223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:19.844644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:19.845056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:19.858527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:19.860473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:19.882236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:19.883599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:19.884669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:19.884669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:19.884669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:19.884669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:19.886419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 270/537] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:19.893081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.045193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:20.051101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b3a34-da3b-4517-9282-7f4e116703b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.087032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.087641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.087919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.088228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.088970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:20.089584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:20.090968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:20.103097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 268/538] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:20.108485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.228096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a86884-b113-41df-a158-1b1b2b742c75 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.267172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.267977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.268287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.268560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.275444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:20.276965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-690a96f3-ce5d-430e-95fe-4329fa07a639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:20.291078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:20.291907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:20.292960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 271/539] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:20.298361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.369866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6af0b-b97e-4ac8-b4b5-7f9376817214 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.370109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6af0b-b97e-4ac8-b4b5-7f9376817214 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.370479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f6af0b-b97e-4ac8-b4b5-7f9376817214 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.371978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 272/540] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:20.378489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.378773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.379049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.400068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:20.402086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:20.448504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:20.462633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87554db-625a-40e3-92e9-c0841f9420e3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.484225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 273/541] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:20.505294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.531367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.532049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.532355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.532631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.533547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:20.533861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:20.535408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:20.562372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 269/542] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:20.568404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.599183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:20.626885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2e02-643a-4562-a850-8c1579d9a5a0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.671137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.672353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.672823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.673586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.685266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:20.694184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:20.695061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:20.695840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:20.703902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 274/543] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:20.705347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:20.719985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b68d17-c268-4204-bcd8-b6e0c4d11439 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.744101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:20.797947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.798617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.798896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.799165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.800016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=21ad18656f0a472783d122a1380d4905) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:20.800357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:20.801801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:20.817147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 270/544] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/role_assignments?user.id=21ad18656f0a472783d122a1380d4905&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:20.860666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1757c-3e12-4693-a284-02d4b697b861 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:20.911132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:20.911779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:20.912064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:20.912388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:20.913189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:20.913508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:20.914983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792d232-e362-43bd-b796-e2e1a426cfcc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:20.928292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 275/545] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:20.939074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.040325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.058250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8c6d5-b1d6-4e9b-a88b-920a3bf3e379 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.093408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.094214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.094488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.094753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.101872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83858-f41e-4d0d-84df-c9617df8b1e9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.101872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83858-f41e-4d0d-84df-c9617df8b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.101872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db83858-f41e-4d0d-84df-c9617df8b1e9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.104294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 276/546] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:21.106620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:21.108158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:21.109635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.110125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.110607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:21.127688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:21.128634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:21.130111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:21.130111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:21.130111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:21.130111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:21.130111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 271/547] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:21.130549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:21.131947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:21.134337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.208424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 277/548] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:21.223667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.279156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf37cd3-8cc4-443c-b02a-23fc8094da44 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.288517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.320147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.320147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.320147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.320147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.320559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:21.320559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:21.320559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:21.322212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.338498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 272/549] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:21.339533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.374866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c06f8-f860-40ed-8e8a-fef78d792d7b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.441119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.441924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.442201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.442470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.470655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:21.478362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:21.479700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:21.481028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 278/550] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:21.488465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.512649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b5f561-a4f0-49a7-bd48-740db40c9092 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.547175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.547986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.548309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.548577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.560872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:21.562318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:21.583276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:21.585392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:21.587617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:21.589055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 273/551] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:21.596197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.671918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.686837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.712082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bcec4-61f4-4905-a62a-a45aeeb00dd1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.720914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28049bd-f012-467f-b382-4c3fdacc12f3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.746162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.746842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.747117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.747385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.748257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:21.748560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:21.749987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:21.767929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 274/552] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:21.773014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.788933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:21.789615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:21.789948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:21.790221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:21.791130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:21.791451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:21.792993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:21.802223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 279/553] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:21.808963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:21.936480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb1bc6-fcd5-4f51-998a-5ec39a02df2c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:21.976581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:21.998454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e397d8-1d9b-46d3-9579-6e53b905116a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.002747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.003408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.003682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.003948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.069070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.069873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.075872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.076182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.096781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.101532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.120543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:22.137020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:22.137950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:22.138788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:22.138788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:22.138788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:22.138788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:22.138996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.142064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a4ba6-644a-469b-959a-0a576692780a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.142341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 280/554] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:22.150698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.301747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 275/555] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 07 03:51:22.303393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec3da-4655-4a7e-9d74-2b6b41c39d1f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.303840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec3da-4655-4a7e-9d74-2b6b41c39d1f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.304283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ec3da-4655-4a7e-9d74-2b6b41c39d1f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.310105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 276/556] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:22.311078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ec3da-4655-4a7e-9d74-2b6b41c39d1f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.311786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d2d51-6f8b-4000-a6e4-2e90757966a5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.327261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.353668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.354428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.354767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.355103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.355892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:22.356296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.358175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7b1fa-fc42-4c8d-8b7f-93955859ab43 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.372231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 281/557] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:22.377878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84206-2e3d-41bd-92d5-058f60098cda None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.378268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84206-2e3d-41bd-92d5-058f60098cda None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.378542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a84206-2e3d-41bd-92d5-058f60098cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.394808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e1a84206-2e3d-41bd-92d5-058f60098cda None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:22.395970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e1a84206-2e3d-41bd-92d5-058f60098cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:22.419527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9ec3da-4655-4a7e-9d74-2b6b41c39d1f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.455304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.456400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.456877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.457209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.458746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.469341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.470811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 282/558] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc9b1-472f-45a6-b55c-e4bcfe5dd407 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc9b1-472f-45a6-b55c-e4bcfe5dd407 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cc9b1-472f-45a6-b55c-e4bcfe5dd407 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 283/559] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:22.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc9b1-472f-45a6-b55c-e4bcfe5dd407 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6469c432-5955-45c2-9a8d-d70f92dcd8cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:22.497921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:22.498834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:22.499698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:22.499698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:22.499698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:22.499698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:22.499698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 277/560] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:22.500747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.501407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.501407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.517863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:22.519077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:22.579173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.592370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cc9b1-472f-45a6-b55c-e4bcfe5dd407 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.600880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 278/561] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:22.602076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.629098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.630014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.630320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.630557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.638841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.640698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:22.656033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:22.657120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 284/562] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:22.658028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.719918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.720687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c1d2c-73e7-4f20-932e-6fc79359a77b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.757794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.758631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.758901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.759167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.759895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:22.760238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.761836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:22.770021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03585-59d5-48b5-95b2-0db301477758 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.778481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 279/563] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:22.779233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.804083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.804918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.805195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.805496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.816332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:22.824148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:22.825064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:22.825881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:22.830329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 285/564] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:22.831103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.839598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.886452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6104ca7-e09e-4ec1-b218-e9d9f0f388e9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.920736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.921606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.921992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.922266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.937936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:22.941270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777c574-fefd-4b38-8c52-3f4e0643b513 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:22.945671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:22.946600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 280/565] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:22.952474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:22.957654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:22.983334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:22.984191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:22.984471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:22.984744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:22.985611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:22.985918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:22.987400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.004636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 286/566] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.005284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.059155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf4e29-a9fc-46f8-bc1f-db32276a6cf0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.074867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.092771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.093496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.093770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.094043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.100574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.102039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.108976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c79d07-e0ee-4334-8ff3-703b20694482 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:23.115839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:23.116770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:23.117690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 281/567] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:23.118251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.144754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.145422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.145699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.145973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.146721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.147024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.148417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.156478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 287/568] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.157250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.185968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.220673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf95d-5f62-41a5-9657-2cdeefa5668b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.255503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27274f84-b3b0-4db6-92d3-4d6036736def None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.255691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.256242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.256541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.256814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.257575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.257904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.259298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46551c-e6ba-44d9-a5b2-124ee59bf967 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.267299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 282/569] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.268546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac04c-c94f-47d9-acb4-ed50bbb3c265 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.268845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac04c-c94f-47d9-acb4-ed50bbb3c265 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.269286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ac04c-c94f-47d9-acb4-ed50bbb3c265 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.270332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 283/570] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:23.272654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac04c-c94f-47d9-acb4-ed50bbb3c265 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.289998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.290776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.291062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.291326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.302123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.303631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.313203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:23.320440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:23.321464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:23.322337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:23.322337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:23.322337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.322337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:23.322337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 288/571] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:23.325007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.375273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ac04c-c94f-47d9-acb4-ed50bbb3c265 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.405002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.408888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.409562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.409840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.410109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.410934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.411240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.412728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.422881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5dc67-5278-4aa5-a09f-8d46489aba27 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.424874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 284/572] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.425510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.456396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.457233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.457515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.457781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.468681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.470165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-85fbc760-0e10-4e9e-99f2-97fa13b1ffa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:23.486813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:23.487793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:23.488813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:23.488813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:23.488813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.488813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:23.488813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 289/573] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:23.489202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.489468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.489742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.505434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:23.506666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:23.522827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.526510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84f04-f144-4918-b254-38dde705db5a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.562878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.563774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.564143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.564427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.571314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 290/574] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:23.572162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.574490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.575956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:23.595070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:23.596108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 285/575] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:23.597204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.634741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.671498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cc2c7-0017-4269-bc10-c913596db5ab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.693741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b504bb-f321-4f42-a307-942d50cb6de2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.704832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.705611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.705954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.706297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.707092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.707402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.708793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.720214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 291/576] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.720997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.731776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.732484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.732796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.733056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.733907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=48a2ed589c5742d3acd30e59e9f1da2d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.734215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.735646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.741213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 286/577] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/role_assignments?user.id=48a2ed589c5742d3acd30e59e9f1da2d&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.741982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.758097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.844248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f23f1-6762-412f-8009-030fda1836b8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.852420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f65769-8477-4c3c-9581-734e32d15a9a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:23.869368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:23.881261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.881974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.882322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.882595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.883484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:23.883859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:23.885387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:23.890588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:23.891398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:23.891673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:23.891941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:23.899713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 292/578] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:23.900341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.909727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:23.918412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:23.919341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:23.920193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 287/579] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:23.920883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:23.998132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.019575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0844da-4caa-406f-93b0-6cc5a617a8fb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.024473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd56209-cb39-4e45-975e-6675daf7fca6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.056354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.057129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.057400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.057757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.058570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.058873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.059859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.060399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.060698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.060970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.061235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.069105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.070915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.077149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 293/580] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.077149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:24.090008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:24.090908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:24.091816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 288/581] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:24.092416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.126629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.186122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8779b55e-61b3-4029-9836-2d3e4d26048d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.195262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf7fe9-82e9-4a3c-8abe-fac9098fc09e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.226604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.227715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.227988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.229119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.235930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.236631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.236894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.237167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.237923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.238042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.238217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.239404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.239564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.240932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.253367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 289/582] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.253367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:24.256729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:24.257658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:24.258662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 294/583] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:24.259228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.357089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd0a21-6a08-433a-b88f-5d1997ac19b7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.360415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9e36cf-f9f6-45f8-b157-c16ba204ac54 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.363413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.394801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.395628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.395881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.396179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.399899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.400596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.400877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.401151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.401944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.402251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.403689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.403890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.405365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.420362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 295/584] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.420362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:24.420621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:24.421568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 290/585] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:24.422480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.480383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.524486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02b188-e0a8-46b4-bbb7-6a7e33c9aed4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.527652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b48886-3bb4-4bcc-b49a-3775ac2830f8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.558063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.558725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.558998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.559265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.560104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.560432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.561859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.564527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.565324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.565601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.565871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.577462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.578891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.583564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 291/586] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.583564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:24.603447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:24.604382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:24.605278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:24.605278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:24.605278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:24.605278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:24.605278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 296/587] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:24.605544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.626321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.685621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe1b8e-8d89-46d7-80f1-543a3608eaa3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.701162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.711324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a4b8f-c950-43be-8df4-43516b749673 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.724887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.725781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.726017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.726285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.741208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=2bd030577928438b940c477cb4fc2456, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.742578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.748608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.749287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.749559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.749827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.750670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.750982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.752765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.762408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 292/588] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:24 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:24.763477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.786825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 297/589] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.788108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.877950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200abe5-fe70-46d7-b3ec-efc428ddf45f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.892637 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:24.915199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.916155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.916418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.916683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.932344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b64818-7596-4111-ac89-322d32a4e965 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:24.949714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.951896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.971735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:24.972466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:24.972752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:24.973018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:24.973750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:24.974050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:24.974739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:24.975568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:24.976709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:24.976709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:24.976709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:24.976709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:24.977421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:24.977519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 293/590] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:24.977909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:24.991165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 298/591] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:24.992174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.003130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.097058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30054c5-f11a-4733-b2aa-f683b323631f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.128914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744e544-df92-43c7-840e-e3e9bb403b5b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.134041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.135068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.135533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.135987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.147056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.148834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:25.167471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:25.168404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:25.169285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:25.169285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:25.169285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:25.169285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:25.169517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.169517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.169517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.169517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.169768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:25.169840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.171212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.172459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 294/592] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:25.173520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.177246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.196204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 299/593] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:25.197376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.256927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.296731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8390f55-7b7a-4512-96e2-1f21a17551a9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.332109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56d3de-03a8-4e03-acb6-8dadef49d8b7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.332828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.333875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.334337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.334790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.343313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.345067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:25.365353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:25.366299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 295/594] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:25.367930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.375119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.376183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.376653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.377152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.378126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:25.378644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.380280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.392595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 300/595] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:25.393849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.460539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.490475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709a3c1-1740-4259-a8c5-c0de4bf9249e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.501025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07d69d-ffcf-4288-9bac-207ba93e6673 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.524159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.535588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.536816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.537102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.537374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.542111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.543018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.543481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.543938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.544890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.545240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:25.545737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.546348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.547554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:25.563331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:25.564268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 296/596] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:25.565825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.569733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 301/597] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:25.570923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.677378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b6637-0655-44e6-9bff-74d17b369d6d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.686638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45be6b-6492-4a71-a2c1-eb1ab68a1a88 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.702180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.712620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.713519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.713801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.714070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.721732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.723284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.726597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.727642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.728111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.728659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.729646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:25.730188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.731867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:25.737916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:25.738887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 297/598] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:25.740379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.748259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 302/599] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:25.749545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.791685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:25.847523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a14187-635b-41fd-ac75-fe1edd5b55eb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.855315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4577b41-bd46-4017-8006-7ce2a11fdae4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:25.882805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.883633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.883912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.884195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.889415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:25.890080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.890355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.890621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.891406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:25.891709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.893201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.894657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:25.896079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:25.911565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 303/600] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:25.911565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4f1dac2f-f042-4982-8bb1-2403e7afbc70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:25.921527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:25.922471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:25.923366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:25.923366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:25.923366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:25.923366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:25.924432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 298/601] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:25.926662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd4a7-08fe-46d6-ab46-40359e9ec2c5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:25.927158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd4a7-08fe-46d6-ab46-40359e9ec2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:25.927641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8bd4a7-08fe-46d6-ab46-40359e9ec2c5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:25.933608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 299/602] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:25.934597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bd4a7-08fe-46d6-ab46-40359e9ec2c5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:25.958547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:26.034269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0cb43-1eef-4b48-96ca-dd1190aafffb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.041959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:26.046471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8bd4a7-08fe-46d6-ab46-40359e9ec2c5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.070506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.071441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.071716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.071987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/f777aaf6bb714c8c949105aa8556c0bc/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.083693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.084933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.085507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.085954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/068cf00a56cc488586b207a13592f6e5/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.086059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=f777aaf6bb714c8c949105aa8556c0bc, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.087557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.101513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 304/603] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:25 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/f777aaf6bb714c8c949105aa8556c0bc/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:26.102363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.102558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=068cf00a56cc488586b207a13592f6e5, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.104605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9b0ad-6af4-4e2a-9af6-a6307aa5277a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.135315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 300/604] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:25 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/068cf00a56cc488586b207a13592f6e5/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:26.136988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.137345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.137679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.175955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:26.183138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:26.276534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:26.308344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc548674-0179-49bc-b68d-5dbf4b0e1dfa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.346914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 301/605] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:26.359146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.359842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.360149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.360431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.361188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:26.361493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.362927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.375034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 305/606] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:26.379398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.382098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.520733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:26.561641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416cea13-ad66-46dc-bf7e-4f7966543134 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.575860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4733015a-5d78-449f-8f8f-9ba16b7702f1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.628875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.630148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.631119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.631638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.643332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.644585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.645627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.646178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.654001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:26.665056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:26.666177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:26.667201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:26.668840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.669534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 302/607] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:26.670646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.677174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:26.691249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:26.692439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:26.693399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:26.695756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 306/608] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:26.704157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.708613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:26.875292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491c8753-8abe-4be5-a59f-e18a12fe9dfe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.892448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea82ca8-dfca-4501-8fdc-d91ea5545a1d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:26.947566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.948277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.948560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.948829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.949632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:26.951063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:26.952152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.952477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.952752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.953532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:26.953825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.955232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44d45e-7680-4208-9bbe-7fc931e30c8d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.956631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:26.958106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:26.969528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 303/609] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:26.971241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd213-711f-4bca-b8af-71387115cd08 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.971526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd213-711f-4bca-b8af-71387115cd08 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.971801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd213-711f-4bca-b8af-71387115cd08 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.976452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 307/611] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:26.977195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 304/611] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:26.977487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:26.978625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:26.978930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:26.979201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:26.985544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.000713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:27.001902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:27.044355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.087921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a176590-05e2-4d2c-ae2f-39712a77e4a5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.094611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 305/612] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 07 03:51:27.096180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.143466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.144224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.144552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.144826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.155394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.156909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:27.178816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:27.180023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:27.180958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:27.180958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:27.180958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:27.180958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:27.180958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 308/613] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:27.181236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.223032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4604733-8821-4bba-b2ba-125e4efcb36a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.257063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.263324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.264266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.264544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.264817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/21ad18656f0a472783d122a1380d4905/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.282273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=21ad18656f0a472783d122a1380d4905, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.283873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.290626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f2f89-6849-4164-bb44-27cd67417509 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.302373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 306/614] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:27 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/21ad18656f0a472783d122a1380d4905/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:27.303500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.309555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.335921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.337260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.337731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.338174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.352458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:27.362124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:27.363362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:27.364392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:27.367189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 309/615] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:27.374253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.508578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13ed85a-87b0-4246-8e8e-917a47998717 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.532170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb7bb7-dfee-430e-9423-aad84582f7a9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.558395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.560443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.560729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.560998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.563826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:27.564162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.565616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.592793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 310/616] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:27.598305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.611249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.611933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.612264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.612538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.613279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:27.613584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.614963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.630984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 307/617] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:27.638398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.639477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.697856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:27.730000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71515b9-7229-4042-9cb3-cad0fc59cad5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.770466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7afbe-e3cd-49e8-98b6-66562bb2dc82 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:27.808400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.809724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.810157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.810645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.814193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:27.815124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:27.815498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:27.815864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:27.819664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.821811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:27.838532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:27.840071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:27.841250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:27.841917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:27.843531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:27.843898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 308/618] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:27.851891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:27.881844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:27.882807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:27.884234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:27.884234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:27.884234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:27.884234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:27.884234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 311/619] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:27.889094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.010411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc11639-175e-471b-bfef-c7db73f777e3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.012202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.065613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.072465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.073195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.073452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.073735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.074585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:28.074893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.076355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.093546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b717ec-1513-405e-867c-9d95318d7d0f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.118801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 309/620] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:28.124502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.130997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.132693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.133145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.135227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.136774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:28.138777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.140373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.166462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 312/621] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:28.172362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.278806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa469c7f-a269-447e-8cad-66a9c4487548 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.298827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6756a8f-1328-4a6f-951a-7989cf9cbf70 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.317273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.318335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.318755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.319165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.336599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.336599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.336599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.336599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.341551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.351884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.352098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.352098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:28.360327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:28.361293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:28.362236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 313/622] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:28.372696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:28.394207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:28.395124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:28.396022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:28.396022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:28.396022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:28.396022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:28.398712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.399958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 310/623] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:28.403524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.431436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.523400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9755bbd-55a4-4911-84c8-eec503eb6d65 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.555047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99517f1-fc85-470b-85b2-892c5ac7fb32 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.557452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.558172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.558444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.558708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.559565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:28.559865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.561375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece91ff-aa00-4585-bb8a-b35fcdbae8df None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.579904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 314/624] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:28.581602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d52e2-38a4-45a5-aa79-683c93fe3c2f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.581892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d52e2-38a4-45a5-aa79-683c93fe3c2f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.582167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d52e2-38a4-45a5-aa79-683c93fe3c2f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.583536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 315/625] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:28.584540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e91e97-614b-472f-81cb-04094727d9d7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.584827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e91e97-614b-472f-81cb-04094727d9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.585093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e91e97-614b-472f-81cb-04094727d9d7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.589583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 316/626] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:28.590027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1d5a9-8308-4388-808b-c1be54be7f3a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.590273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1d5a9-8308-4388-808b-c1be54be7f3a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.590564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1d5a9-8308-4388-808b-c1be54be7f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.604993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.605995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.606463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.606952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.607230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-baa1d5a9-8308-4388-808b-c1be54be7f3a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:28.608144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:28.608499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-baa1d5a9-8308-4388-808b-c1be54be7f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:28.608911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.610746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.623486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 311/627] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:28.624631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.673689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.691037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 317/628] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:28.691037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.691037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.691037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.702526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.713896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:28.715456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:28.735292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61bdc-4ddc-4b8d-a110-e23202f239df None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.769627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.770284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.770558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.770868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.788160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 318/629] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:28.788160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.849916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.851298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.893442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93078222-c4c6-4776-9c0d-b1ed607a1673 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:28.927575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.932331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:28.942606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:28.943439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:28.943716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:28.943965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:28.951808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:28.953329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:28.967059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:28.968083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:28.969046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:28.972976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 319/630] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:28.973920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:28.974036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 312/631] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:28.974839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.076952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f304c-c28b-4dd3-95e2-0ddf3d9a3a05 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.077161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bc9b3-0c8c-486a-8cc5-27014aa92a9a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.111580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.111777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.112340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.112458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.112626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.112726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.112880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.112981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.122918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:29.123191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:29.130629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:29.131567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:29.132457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:29.133111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:29.133928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:29.134762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:29.136886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 313/632] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:29.137093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 320/633] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:29.137578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.137790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.170692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.188788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.244818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d4f42d-4aa6-4699-b84b-53710b6c8381 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.245014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5e0d2-e0cc-4e48-97d7-478ee7c42809 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.279462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.280269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.280543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.280808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.281099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.281767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.282044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.282316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.283223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:29.283530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.285105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.292064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.293525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.302615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 314/634] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:29.302615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:29.315999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:29.317307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 321/635] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:29.318182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.408026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.417874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc535d-aa93-404b-9577-f7f6ea72046c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.420363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.424644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881505fd-2246-4e3f-a82a-10495134d09f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.458074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.458783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.459069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.459342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.459689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.460139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:29.460415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.460516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.460692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.460961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.461767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:29.461947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.462044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.463413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.480042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 315/636] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:29.480042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.480327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 322/637] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:29.480327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.579825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d0c89-3b08-4839-8024-1e06b6fde5b7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.582744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6baf3-280c-4b73-bddf-b50870bd0ad9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.614208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.615187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.615613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.616031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.616783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.617104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:29.617546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.617736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.618016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.618284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/48a2ed589c5742d3acd30e59e9f1da2d/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.619561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.634330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=48a2ed589c5742d3acd30e59e9f1da2d, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.635899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.637355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 323/638] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:29.638030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.656147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 316/639] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:29 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/48a2ed589c5742d3acd30e59e9f1da2d/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:29.656147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.662766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.663316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.762822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf917de-b3e3-4525-a5f9-1b67137f53a1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.803062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.804310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.804842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.805270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.805584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2307855-bfef-4f0d-aae5-2b041191c7d2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.818737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.820924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:29.840466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:29.841593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:29.842859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:29.842859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:29.842859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.842859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:29.842859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 324/640] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:29.843278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.851265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:29.852214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.852568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.852846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.863822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:29.865428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b374810c-963c-4c22-bf7f-e87f668afd9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:29.885263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:29.886424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:29.887503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:29.887503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:29.887503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:29.887503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:29.888051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 317/641] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:29.889066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ff88-1e32-44ce-aa13-1ebf3a067499 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:29.889343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ff88-1e32-44ce-aa13-1ebf3a067499 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:29.889606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4847ff88-1e32-44ce-aa13-1ebf3a067499 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:29.890988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 318/642] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:29.891529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847ff88-1e32-44ce-aa13-1ebf3a067499 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:29.935104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:29.959265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33755ce-e061-4468-b3a5-e841c2f069c4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:29.969374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.001262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.002387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.002833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.003276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.010431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.012093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.017594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4847ff88-1e32-44ce-aa13-1ebf3a067499 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:30.026820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:30.027758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:30.028786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:30.034933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 325/643] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:30.034933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.055631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.056370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.056648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.056907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.057642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.057942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.059349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4d893-b0ab-49b3-8c0b-e7a7fae9b630 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.072169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 319/644] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.073538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.073826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.074097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.091460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:30.092691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:30.142505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555579e-5a48-4b57-a51f-ea0e047af46d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.166390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 320/645] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:30.167251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.183488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.189695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.190655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.191155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.191660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.192704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.193194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.194882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.208059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 326/646] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.209135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.226409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.293438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95102a74-09d3-43a9-a14d-6d0dac74a6f4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.327617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e946ea-add8-46e8-8fbe-5a458a30a5e2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.330223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.330894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.331173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.331446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.332286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.332599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.334033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.348487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 321/647] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.354016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.364255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.365134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.365614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.365727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.374611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.376072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:30.390120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:30.391085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:30.392016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 327/648] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:30.392662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.449699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.471254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2d05b-c608-43c8-be75-1cfc15b88a07 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.478823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.502756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1521c-47fc-48b0-b415-7c7d81eb5f9d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.508425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.509250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.509529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.509803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.519974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:30.527656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:30.528600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:30.529425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:30.533798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 322/649] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:30.534648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.539654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.540515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.540790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.541056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.549053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.550518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:30.565538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:30.566459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:30.567393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 328/650] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:30.567985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.646040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf863af-fcc7-418b-93b4-c237c00a0d8b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.676595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9551b-2962-4aaf-99f4-b3341d2e70d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.682078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.682753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.683026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.683290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.684136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.684464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.685909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.690278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.692096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 323/651] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.701169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.724457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.726229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.726579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.726954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.728012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.728405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.730020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.741630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:30.757064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 329/652] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.758130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.838863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e487e-058a-4f82-9efa-2833850e43aa None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.871566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa33485e-d228-4eab-825e-ddb2e6deb8cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:30.886802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.887488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.888036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.888343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.889113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.889410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.891628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.901693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 324/653] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.902617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.916566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:30.917250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:30.917529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:30.917800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:30.918859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:30.918983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:30.920405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:30.944670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 330/654] 10.222.0.26 () {56 vars in 1137 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:30.944670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:30.980008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.022421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.032515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760d0e-942c-4817-b7f7-0672d2820682 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.074860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e0f0a-32b0-4759-9b80-c30997abbf51 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.079807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.080499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.080777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.081047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.111854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.113044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.113528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.113986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.125094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.126915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:31.146118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:31.147065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:31.147968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:31.147968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:31.147968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.147968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:31.150365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 331/655] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:31.151363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.166255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.168027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.258264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.270437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.284042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 325/656] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:31.285277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.289785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d61405-e4a3-4d57-b4e0-2ed9e852edb6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.329398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.330183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.330379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.330603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.397768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb7992-82da-4fcd-bab7-42858d2a62ab None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.415881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.417456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.436350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.437377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.437858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.438415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.439352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:31.439874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.441646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.454724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 326/657] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:31.455920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.502979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.516819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.529014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 332/658] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:31.529014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.576817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe327e-143d-47ed-92e3-21f26d4c685e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.614671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.615839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.616380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.617038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.626545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b5aa6-a4fc-4ecc-b354-fb7b8c03c4ca None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.629719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.631708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:31.651072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:31.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:31.652895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:31.652895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:31.652895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.652895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:31.655327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 327/659] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:31.656392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.665613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.666472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.666746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.667017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.674813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.676357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:31.690977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:31.691951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 07 03:51:31.693207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:31.696451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 333/660] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:31.697348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.743826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.769979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81596cea-11db-4bec-b0f7-3e383b732ec6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.773196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:31.804190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.805198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.805478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.805750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.809641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900e6a5-d405-4a76-bf66-e5ab9d5653cb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.817270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.818719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:31.835846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:31.836897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:31.837858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:31.837858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:31.837858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:31.837858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:31.837858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 328/661] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:31.838260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.853299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.854194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.854615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.855200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.856213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:31.856670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.858354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7861fd-d1d3-486b-9e69-614c82228cc3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:31.871662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 334/662] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:31.873298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70e51-37fa-47c5-a371-f3f70fe358d1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.873581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70e51-37fa-47c5-a371-f3f70fe358d1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.873853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df70e51-37fa-47c5-a371-f3f70fe358d1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.875247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 335/663] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:31.880029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70e51-37fa-47c5-a371-f3f70fe358d1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:31.957042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c4ca1-f939-4c28-bbbb-c0efabb042cc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:31.996168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:31.996836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:31.997116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:31.997392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:31.998241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:31.998544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:31.999983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.003809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.008874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df70e51-37fa-47c5-a371-f3f70fe358d1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.023211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 329/664] 10.222.0.26 () {56 vars in 1139 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:32.023211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.037935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.047794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.048489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.048771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.049042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.049771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:32.050072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.051457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95e1207-4ef1-4eb6-a866-a2d76b5dcc97 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.068187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 336/665] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:32.070086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.070558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.071039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.088034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:32.089563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:32.130770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab7932-34e0-498b-a4c0-395a30094b39 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.160162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 337/666] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:32.160640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.178419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.179686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.180094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.180855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.188457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.189914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:32.203606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:32.204503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:32.205380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 330/667] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:32.206670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.258855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.268405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f0e06-780c-4594-9458-98ac3699ca23 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.292859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.313032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.313800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.314142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.314421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.321667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d75771a-7e58-4de4-8d0c-cacb6ebcc9db None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.358779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.359584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.359866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.360158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.367298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.368883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:32.384819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:32.385719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:32.386589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 331/668] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:32.387450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.392665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.394154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.488798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.490519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f30ac-cebd-4771-aa83-cb8d71f08430 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.501646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 338/669] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:32.503246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.526777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.527574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.527853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.528142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.530373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.542144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:32.551570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:32.552536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:32.553360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:32.554669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 332/670] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:32.554669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.610229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51c005-ba1f-447f-809f-31a64c17bb89 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.646841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.647506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.647787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.648055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.648928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:32.649234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.650694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.661946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400a6ed2-3d68-415f-80ef-1cec23e60f86 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.667686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 339/671] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:32.667686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.701618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.702407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.702897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.703179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.704001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:32.704338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.705776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.718515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 333/672] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:32.719415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.724145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.775912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.782037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1bb0f-0bc6-4c98-bf50-55c6f6e9a6d2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.820596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e790ed-c1f9-4188-a8f9-4a64c022c8df None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.824254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.825062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.825342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.825619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.839450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.841375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.855423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.856095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.856400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.856665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:32.857417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:32.857717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:32.859069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:32.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:32.860288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 340/673] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:32.861660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.869037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 334/674] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:32.869676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:32.961715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b6869-9dbc-4737-b4df-ef69bee01555 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.963216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.971914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7609b-d499-4eb6-b114-a4b5010ebdd6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:32.987981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:32.997954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:32.998939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:32.999221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:32.999497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.000376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=068cf00a56cc488586b207a13592f6e5) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.000691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.002164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce1cdb-406a-4e38-b2f2-bc9efe836f61 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.005987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.006647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.006925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.007197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.007969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 341/675] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/role_assignments?user.id=068cf00a56cc488586b207a13592f6e5&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.008142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=f777aaf6bb714c8c949105aa8556c0bc) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.008407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.009261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61196-8bec-4834-bbc5-eaf7a8a0bd38 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.009545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61196-8bec-4834-bbc5-eaf7a8a0bd38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.009817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b61196-8bec-4834-bbc5-eaf7a8a0bd38 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.009910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.011231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 342/676] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:33.011738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61196-8bec-4834-bbc5-eaf7a8a0bd38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.015673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 335/677] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:32 2022] GET /identity/v3/role_assignments?user.id=f777aaf6bb714c8c949105aa8556c0bc&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.016517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.153190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b61196-8bec-4834-bbc5-eaf7a8a0bd38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.162980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c81c-aa72-4a8a-8b4c-a88c1bac368e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.198419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.199099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.199376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.199648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.200420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.200726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.202120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c1e0-8bb6-4adc-aab1-7fe5edf1a0fe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.212317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.213610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.214353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.214791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.215087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 343/678] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.217184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.217478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.217754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.230062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.232655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.235732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:33.237462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:33.253543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:33.254537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:33.255563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:33.255563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:33.255563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:33.255563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:33.255563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 336/679] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:33.255902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.263806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.303216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.325236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 344/680] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:33.326442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.379305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428a6f0-aa6e-4966-9adf-163c16fea276 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.415771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.416446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.416722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.416989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.424632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.426433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.429272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9783fc-9061-47d9-8e5e-eb91436377b8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:33.441610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:33.442742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:33.443892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 337/681] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:33.444614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.469977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.471088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.471833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.472289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.473406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.474010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.476229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.491712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 345/682] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.492917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.516086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.563341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e32f0-d629-4cc2-b02c-ebf85a8a287e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.583640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.609593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566ffe74-7192-4c52-99eb-fc8bae248465 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.609782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.610414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.610749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.611278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.625047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:33.635056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:33.636050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:33.636905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:33.637526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 338/683] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:33.638062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.652335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.653117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.653393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.653670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.654552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.654885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.656579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.669678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 346/684] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.670435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.756658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc83bb5-b9fb-42f9-8878-5da3fbf3b30b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.768158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.797587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.798394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.798719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.798997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.799976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f46615-174c-4e91-86cc-71461c5be94a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.807110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.808636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:33.823639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:33.824889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:33.826040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:33.828387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 339/685] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:33.829274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.843911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.844880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.845305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.845740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.846630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.847074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.847195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:33.849109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.863224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 347/686] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.864373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:33.949115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcb648-8c6a-4666-963f-a574b626a03d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.968199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b2039-8cc9-46d0-a2d1-0416e793eda3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:33.984732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:33.985391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:33.985663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:33.986108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:33.986762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=21ad18656f0a472783d122a1380d4905) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:33.987066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:33.988696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:33.996639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 340/687] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/role_assignments?user.id=21ad18656f0a472783d122a1380d4905&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:33.997362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.004729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.005822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.006298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.006762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.007861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:34.008509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.010257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.020173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.032460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 348/688] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:34.037951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.089931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.117032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd9cf4-94d6-4cbf-967d-eaf2c4a31b17 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.153885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.155106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.155595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.155699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319edf15-9470-483b-a102-c06f187ea3b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.156194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.168726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.171669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:34.190834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:34.191728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:34.192640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:34.192640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:34.192640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:34.192640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:34.194905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 341/689] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:34.195284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.196058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.205696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.205696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.206025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.310876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.320654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.322554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.363995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a26de-3048-4907-a055-3853dfde9a47 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.399822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.409531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.410203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.410479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.410749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.411642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:34.411943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.414127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.428901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 342/690] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:34.434594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.452450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 349/691] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:34.462923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.560485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.564639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73f678-4231-43d6-8432-87512b331cd5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.608074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.609286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.609894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.611366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.630782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.636335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:34.670002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:34.670924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:34.671866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:34.671866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:34.671866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:34.671866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:34.674638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 350/692] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:34.676765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b89d01-f90c-4581-85fc-002707bc48b0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.684139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.719807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.720588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.720867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.721153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.738437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.739985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:34.758870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:34.759891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:34.760893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 343/693] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:34.765916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.836586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.836796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3712d-f345-456a-bb47-adbc4d94fec6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.881266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacc842-8b3f-4a0a-9101-e2ce283176b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:34.896162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.897064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.897512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.897939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.898873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:34.899312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.901692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.924598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 351/694] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:34.930262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:34.950815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:34.951857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:34.953804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:34.954242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:34.955244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:34.955710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:34.956984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:34.958533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:34.996068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 344/695] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:35.002103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.103059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ac7f-f01b-49ea-8d4d-37adacc8c3e9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.154675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.155901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.156401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.156893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.164852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.166591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.177246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac62e62-e811-4fe6-a9f0-ee2f4e16a7c0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:35.182726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:35.183650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:35.184620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:35.187131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 352/696] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:35.192950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.195844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.244835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.245513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.245793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.246066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.269639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.312206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b74c67-93c6-4b90-b45a-09cf776b4f66 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.352143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.353178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.353680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.354223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.355248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:35.355753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.357630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bcc30-cd91-4b0a-be10-c555b044c270 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.371341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.372433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 353/697] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:35.372969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8b136-730a-4563-9c22-7d7d3bc5c5b3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.380602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ed7a-6664-48eb-b421-89b7982a34ca None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.381333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ed7a-6664-48eb-b421-89b7982a34ca None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.381923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ed7a-6664-48eb-b421-89b7982a34ca None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.384092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 354/698] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:35 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:35.386323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ed7a-6664-48eb-b421-89b7982a34ca None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.489422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 345/699] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:35.489422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5226-50c7-4b82-b718-9dcc96f77691 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.489422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5226-50c7-4b82-b718-9dcc96f77691 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.489422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b5226-50c7-4b82-b718-9dcc96f77691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.500720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.503525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6314ed7a-6664-48eb-b421-89b7982a34ca None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.507929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b25b5226-50c7-4b82-b718-9dcc96f77691 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:35.509295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b25b5226-50c7-4b82-b718-9dcc96f77691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:35.533765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.543182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.543905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.544156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.544544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.545410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=48a2ed589c5742d3acd30e59e9f1da2d) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:35.545693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.547124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f666-5224-4a48-a1a8-aa2a26fb1484 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.553741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 355/700] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/role_assignments?user.id=48a2ed589c5742d3acd30e59e9f1da2d&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:35.555156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706762fb-34ed-4f57-a2f3-84f1d69d29ed None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.555439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706762fb-34ed-4f57-a2f3-84f1d69d29ed None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.555712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706762fb-34ed-4f57-a2f3-84f1d69d29ed None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.556992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 356/701] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:35.557715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706762fb-34ed-4f57-a2f3-84f1d69d29ed None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.610752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 346/702] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:35.612316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.612607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.612881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.632808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:35.634596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:35.705048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706762fb-34ed-4f57-a2f3-84f1d69d29ed None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.734495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 347/703] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:35.735433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.746738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.747552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.747829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.748100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.758411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.759882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:35.777825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:35.778772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:35.779715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:35.779715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:35.779715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:35.779715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:35.779715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 357/704] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:35.780591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.819282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.837646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:35.868843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9a11f-a75a-4f42-9ff3-c78b33658e39 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.909812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.910833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.911242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.911615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.916894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f188a-b854-44fe-8b12-3d20f8cda620 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:35.924097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.925658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:35.954947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:35.955884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:35.956813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:35.956813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:35.956813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:35.956813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:35.957042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:35.957042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:35.957042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:35.957042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:35.957301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:35.964200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:35.964337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 348/705] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:35.964337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:35.979333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:35.980870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:35.981883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 358/706] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:35.983045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.076275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb49b56-a26e-44d6-879d-d737e1a7d78f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.097672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.117789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.118650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.118816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3970ce-dc6a-405c-998c-61004468854f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.119118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.119512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.120375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.120847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.122328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.131594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.137274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 349/707] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.138437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.172245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.173191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.173642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.174003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.174978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.175362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.177013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.197514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 359/708] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.197514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.258616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce13d6-1c77-495f-b2bc-a10dee662a96 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.299411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.300286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.300667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.301004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.301795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.302163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.303675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.308989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 350/709] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.309987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.331780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505d6a1-2582-4852-ad2e-cbf1a8839e73 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.359094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.375701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.376781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.377131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.377725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.386320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.387960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:36.403297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:36.404495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:36.405613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:36.406140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 360/710] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:36.406864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.432828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c0984-c3d0-4461-b9f5-b4e89af3e66b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.440028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.479793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.481375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.481802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.482245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.483115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.484980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.511838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 351/711] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:51:36 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:36.512992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.541444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ce524-f768-4198-8a49-114c3cc94a9c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.579515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.580268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.580556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.580875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.581626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.581985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.583599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e41cef-3407-4a6f-bd10-70e90cd80c11 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.591063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 361/712] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.592479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82d2a-2597-4a2d-b4b7-96da0fb1d433 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.592798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82d2a-2597-4a2d-b4b7-96da0fb1d433 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.593075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f82d2a-2597-4a2d-b4b7-96da0fb1d433 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.599126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 362/713] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:36.600668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.600948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.601226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.619455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:36.620767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:36.662038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.664996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8da122-b6c5-4d59-ba83-0078bf135206 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.712285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.713423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.714338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.714845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.715945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.716467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.718993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.736081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 352/714] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.745798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.760588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 363/715] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:36.781633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:36.807847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:36.872254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e260b831-08c9-44c5-afb0-f83d5a28414f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.919815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.920760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667e8b9-a2bf-4b37-89e7-bf15886a44dc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:36.921123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.921593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.922069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.924055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:36.924635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.926316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.933982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 353/716] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:36.971087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:36.972329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:36.972797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:36.973252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] PATH_INFO: `/v3/services/network` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:36.974132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:36.975748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:36.991585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:36.992691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:36.993499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:36.997862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 364/717] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:36 2022] GET /identity/v3/services/network => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:37.005486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:37.036499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:37.134841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdf3792-7cd7-49e3-8181-9fb86e27ad6d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:37.185862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:37.186845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:37.187262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:37.187668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:37.188555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:37.189017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:37.190568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe49c428-09f1-4915-af72-ddd0bb1aa417 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:37.195996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 354/718] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:37.202341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:37.299745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:37.320932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f943c3-9f3c-4376-a9a7-2c4b14b2c748 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:37.365233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:37.365936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:37.366219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:37.366488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:37.367267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:37.367598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:37.369140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d23afb-eb28-4501-bdfd-9cccff665a66 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:37.380528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 365/719] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:37.919890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03ccc-09a9-40fc-bff2-bb16161ba6ff None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:37.920794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03ccc-09a9-40fc-bff2-bb16161ba6ff None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:37.921229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b03ccc-09a9-40fc-bff2-bb16161ba6ff None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:37.922984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 355/720] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:37.928026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:37.928788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:37.929200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:37.953197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:37.954378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:38.077777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 366/721] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:38.135087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03ccc-09a9-40fc-bff2-bb16161ba6ff None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:38.297562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:38.331363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b03ccc-09a9-40fc-bff2-bb16161ba6ff None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:38.404850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:38.405740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:38.406025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:38.406297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:38.424977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:38.433078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:38.434052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:38.434918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:38.439461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 356/722] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:38.440497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:38.594262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:38.617459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3b9f8-b789-4d2b-a939-2c1e71e918a0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:38.657376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:38.658102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:38.658384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:38.658655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:38.659477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:38.659807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:38.661346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:38.675796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 367/723] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:38.677207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:38.826286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb83c00b-b0c7-405d-8c59-ec0b5ba257ff None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:38.874822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:38.875976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:38.876476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:38.876961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:38.891329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:38.901193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:38.908747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:38.926760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:38.928048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:38.929051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:38.929051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:38.929051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:38.929051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:38.931390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 357/724] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:38.941168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.066938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0e8e6-b14b-43b6-865e-0b1b41268fa9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.102066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.102793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.103073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.103352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.104190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:39.104673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:39.106058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780a990-1f82-4299-8c65-04c4621e4005 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:39.122908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 368/725] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:39.124338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.254017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663fc5a-a005-4da2-b229-d0b33b493684 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.254218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663fc5a-a005-4da2-b229-d0b33b493684 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.254511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663fc5a-a005-4da2-b229-d0b33b493684 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.257242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 369/726] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:39.259068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8692d-1d41-418e-b1d0-16b019b87928 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.261307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.261588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.261859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.276466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:39.295847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:39.297112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:39.301657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.302491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.302769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.303036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.313446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:39.314895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:39.335260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:39.336297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:39.337225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:39.343356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 358/727] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:39.353899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.405823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 370/728] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:39.440464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.447745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:39.494821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5e89e-7064-4ef0-92f2-99b4a7027165 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.534834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.535522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.536342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.536629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.537497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:39.537805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:39.539728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff1799-1548-4cf8-8b74-45a17e66e064 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:39.562473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 359/729] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:39.564107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e064cb-3554-49bb-a5f7-eb40461ed7b6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.564555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e064cb-3554-49bb-a5f7-eb40461ed7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.564968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e064cb-3554-49bb-a5f7-eb40461ed7b6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.570812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 360/730] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:39.573026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d540-c0f0-49f6-b92e-18677d0df9ae None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.573631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d540-c0f0-49f6-b92e-18677d0df9ae None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.574217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06d540-c0f0-49f6-b92e-18677d0df9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.574532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39d113-60a1-409a-bdf8-e7a43716b427 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.592380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2c06d540-c0f0-49f6-b92e-18677d0df9ae None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:39.593800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2c06d540-c0f0-49f6-b92e-18677d0df9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:39.612403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:39.618997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.619960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.620267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.620539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.621708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:39.623741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:39.644052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 371/731] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:51:39 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:51:39.645056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.696504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 361/732] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:39.714098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1a30-8068-4836-b526-0cbc35300e7c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.714666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1a30-8068-4836-b526-0cbc35300e7c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.715108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed1a30-8068-4836-b526-0cbc35300e7c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.717180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 362/733] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:39.720994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1a30-8068-4836-b526-0cbc35300e7c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:39.774586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:39.786873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c27cfd-3306-4a18-8e0b-488d93b66e76 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.832002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.832002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.832002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.832002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.852565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed1a30-8068-4836-b526-0cbc35300e7c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:39.903300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:39.904192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.904494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.905011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.910633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:39.922674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:39.924295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:39.925983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-97d0e462-cbfb-4b52-8951-45c02805a508 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:39.932220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:39.933472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:39.934293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 363/734] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:39.935483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:39.935483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:39.935767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:39.962712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:39.964538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:40.038455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 364/735] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:40.039731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.044151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 372/736] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 07 03:51:40.045159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.080513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.150212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.152234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98edc55a-1bc4-4994-b98c-6b7d6df23168 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.161086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73794ef-ab26-4a09-98e1-fd1289aee6c4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.186189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.186881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.187140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.187409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.188185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:40.188518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.189863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.197864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 365/737] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:40.198497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.198636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.199642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.199977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.200338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.213502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.215468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-28a731cf-8004-4dd5-b11d-7ed6e8d7714f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:40.234134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:40.235122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:40.236009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:40.236009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:40.236009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:40.236009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:40.236009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 373/738] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:40.236761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152012be-40cf-4457-a183-9b4ba905f4c0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.236933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152012be-40cf-4457-a183-9b4ba905f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.237170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152012be-40cf-4457-a183-9b4ba905f4c0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.238674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 374/739] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:40.239200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152012be-40cf-4457-a183-9b4ba905f4c0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.305752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.315094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f6b02-5103-4a28-b188-a5efe9060fde None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.352166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.352997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.353194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152012be-40cf-4457-a183-9b4ba905f4c0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.353322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.353537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.368308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:40.378312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:40.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:40.380247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:40.382588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 366/740] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:40.383567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.395697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.396510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.396785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.397054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.407931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.409428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.412647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3c99f9f5-19d3-4f70-83dd-d843cf30fe37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:40.428590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:40.429554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:40.430529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:40.430529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:40.430529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:40.430529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:40.434636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 375/741] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:40.435761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.436037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.436538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.455323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:40.456607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:40.496444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09308da5-c4c0-41e9-8de7-bb1cb298a68d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.536155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 376/742] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 07 03:51:40.536155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.539795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.540619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.540972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.541381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.542190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:40.542564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.544111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.562372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 367/743] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:40.563181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.578732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.640038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bcb89-f4e1-498e-b40c-4f2c1cd6efa7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.663568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7575-c14c-40b4-8c40-263ec24fae34 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.674884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.686813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.688027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.688452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.688734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.689501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:40.689810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.691218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.700732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 377/744] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:40.701313 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.705747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.706509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.706787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.707049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.707783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:40.708085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.709475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.725919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 368/745] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:40.725919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.802047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:40.814726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de186f74-4c15-4003-9664-7a762392c381 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.830314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff90bd3-e884-49bd-b207-ef9aa4c1355b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:40.849093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.849760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.850032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.850306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.851025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.852540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.865598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:40.876209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 378/746] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:51:40 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:40.876462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:40.876462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:40.876462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:40.876696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.885000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:40.886653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:40.908053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:40.909072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:40.909984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:40.912284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 369/747] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:40.913232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:40.948436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.013670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57160b1-80e9-442a-95f1-c05fb68edd14 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.040359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03df8ea-81bc-4613-9007-6acd611ddac7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.052602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.053449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.053731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.054002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.065528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.066948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.078690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.079512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.079786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.080102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.082092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:41.085889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:41.086752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:41.087628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:41.087628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:41.087628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:41.087628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:41.087628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 379/748] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:41.089083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.093964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.095660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:41.112133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:41.113080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:41.113997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 370/749] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:51:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:41.114598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.193360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.199955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9837f-d97c-4321-8dd5-2bcb1849a628 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.234419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.235227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.235598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.235989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.236892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:41.237295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.238822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.245537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eebe9db-dfbe-4ef7-9858-bba86707fb70 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.251279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 380/750] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:41.252107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.287716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.288700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.289183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.289595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.290465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:41.290912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.292466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.310756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 371/751] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:41.310756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.364626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026e3-1341-4101-b4c2-54076bfed793 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.372914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.402653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.403492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.403873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.404256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.405242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:41.405665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.407417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.422898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079b16d-0fc2-4701-975d-0c40adaefc0c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.435531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 381/752] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:41.435531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.456499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.466439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.467377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.467849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.468297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.469418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=48a2ed589c5742d3acd30e59e9f1da2d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:41.469922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.471503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.483348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 372/753] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/role_assignments?user.id=48a2ed589c5742d3acd30e59e9f1da2d&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:41.484563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.552330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfd21d-2b1b-42ec-9039-2b4ab10f1dc5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.605040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.605860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.606138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.606408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.622560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.623988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.707309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e8610-a3b9-4024-a7c9-1bae740e548f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.729986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.764865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.765540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.765817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.766085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:41.788155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:41.789202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:41.790165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 382/754] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:41.795253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:41.880652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:41.888497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.890730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c18b46-e9d4-4e64-aa69-7a52bf92918c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.911151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71016051-d9d8-43f3-aedd-8333cc90bf55 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:41.955162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:41.956293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.956677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.957181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.958428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:41.958839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:41.960613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac25cf-cc39-4475-8ac4-bfc881422792 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:41.983979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 383/755] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:41.985381 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2afb-c87e-4dc2-84c2-855db21f7b05 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:41.985675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2afb-c87e-4dc2-84c2-855db21f7b05 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:41.985949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e2afb-c87e-4dc2-84c2-855db21f7b05 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:41.991866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 384/756] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:41.992754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2afb-c87e-4dc2-84c2-855db21f7b05 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.024509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 373/757] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:42.026506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.027047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.027325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.047930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:42.049436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:42.067610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.110462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e2afb-c87e-4dc2-84c2-855db21f7b05 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.132095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 374/758] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:42.133024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.153385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.165533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.166420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.166791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.166956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.185641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.187246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:42.205791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:42.206908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 385/759] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:42.207951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.244872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f490da-6fc5-497d-89de-c985f2e2b572 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.281211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.282251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.282671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.283081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.294276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.296068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.311418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf196c-93fc-49b5-9745-15c32ec2e358 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:42.314913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:42.315954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:42.317066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:42.317066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:42.317066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:42.317066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:42.318978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 375/760] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:42.319975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.347234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.348050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.348358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.348635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.349319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.350682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.360893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:42.363233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:42.364727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:42.365553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:42.368230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 386/761] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:42.369089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.421026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.439783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419fa9-18c8-422d-98b1-11e893c34a2d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.473243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd7173-0494-4354-ab8c-d55eb98bc235 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.483618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.484448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.484731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.485004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.485746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:42.486051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.487544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.504270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 376/762] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:42.505366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.508684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.509362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.509648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.509901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.511356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:42.511356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.512316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.524961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 387/763] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:42.525916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.571701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.618728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e62c9e-017c-430b-a739-5a0c2bab7b60 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.626623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfa6b9-34cf-4025-a9ec-6345f66d51da None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.637000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.659427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.660107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.660426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.660717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.661600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:42.662186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.663910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.667073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.668070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.668548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.669100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.672249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 377/764] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:42.673276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.679435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.681284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:42.696183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:42.697083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:42.697969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:42.705020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 388/765] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:42.706089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.800109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4727ab-9bca-44ed-894c-842df5e30e57 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.832315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.844499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.845453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.845844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.846200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.850459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df0cb4d-655e-443e-b5dc-63a50bdb3e1d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:42.854158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.855503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:42.870572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:42.871629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:42.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 378/766] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:42.873242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.898697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:42.899898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:42.900767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:42.901189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:42.902334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:42.903035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:42.905405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:42.912950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 389/767] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:42.913968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:42.954773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:42.984543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f23dcd4-1a0d-4a35-83da-3515fedaf485 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.020100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.020759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.021171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.021507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.022401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:43.022803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.024381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.040418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 379/768] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.041352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.045943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a7384-4ffa-4ad0-998c-733922332b82 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.092850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.094212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.094673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.095095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.096535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:43.097234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.098970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.099751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.123479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 390/769] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.123479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.166431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d7ff1-4c82-44d0-95d9-0f7ebe43f063 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.201599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.202283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.202476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.202748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.203553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] RBAC: Adding query filter params (interface=public, service_id=26568721d71a4d6695a0b1278282c624, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:43.203869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.205276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df723c49-ff66-4be0-9606-62239faf191d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 380/770] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/endpoints?service_id=26568721d71a4d6695a0b1278282c624&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc449c5-9e2b-4cb4-9db3-01b17ce198c2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc449c5-9e2b-4cb4-9db3-01b17ce198c2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc449c5-9e2b-4cb4-9db3-01b17ce198c2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 381/771] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:43.217482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc449c5-9e2b-4cb4-9db3-01b17ce198c2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.218958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.229418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f54910-2e31-4e7e-94e8-fea87a90f91b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.270427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.271342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.271609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.271879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.273914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=2bd030577928438b940c477cb4fc2456, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.275345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.290317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 391/772] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:43 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:43.291453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.328364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc449c5-9e2b-4cb4-9db3-01b17ce198c2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.340384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.377780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.379276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.380374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.380861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.382206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=97f96a1dea234550944a94d3eaac4aed) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:43.383006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.385434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a83da6-7d56-4033-b4f7-6526587dcd4c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.398012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 382/773] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/role_assignments?user.id=97f96a1dea234550944a94d3eaac4aed&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.399974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.400571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.401040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.428850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355d6c7-db47-4410-bd4b-c729a9a26dc3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.433808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:43.444833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:43.474484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.474484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.474484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.474484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.474896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.476329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.483957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 392/774] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.536544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 383/775] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:43.562552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.584369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.684598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c87b4-e7a8-45fd-8f9d-934af40a3f2e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.725922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.727157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.727658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.728139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.728982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.730552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-82bfd4fb-354a-48ab-b962-05b2c1267de4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:43.742976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:43.743966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:43.744828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:43.747630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 393/776] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:43.753729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.804359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2175bd-38aa-42d9-9556-c194f4373e1d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.804875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2175bd-38aa-42d9-9556-c194f4373e1d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.804978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2175bd-38aa-42d9-9556-c194f4373e1d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.806602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 394/777] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:43.812240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.812462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.812742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.830644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:43.831216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:43.865363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3c4914-5f75-4969-83a6-613f5c8b1898 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:43.867840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.917162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:43.917904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:43.918188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:43.918463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:43.919203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:43.919508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:43.920928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:43.923507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 395/778] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:51:43.928171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 384/779] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:43.938288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:43.960484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:43.979131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.067283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e6c6d-9a2c-4b81-88e7-82b1328bed9c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.090104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6549f0-d699-4ae9-9853-72d67e696c70 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.103261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.103965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.104281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.104559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.105294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:44.105712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.107218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.113129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 396/780] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:44.121314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.146556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.147391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.147670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.147945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.169906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:44.186228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:44.187374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:44.188268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:44.192466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 385/781] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:44.198180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.249297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:44.267556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:44.296975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18c4dc-78b0-4a7e-af8e-347cef13cdb9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.332581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.333820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.334289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.334818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.335887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] RBAC: Adding query filter params (interface=public, service_id=5fd4b7c4947344e0ab57a3a11c3e8b9f, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:44.336592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.338380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.347075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 397/782] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/endpoints?service_id=5fd4b7c4947344e0ab57a3a11c3e8b9f&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:44.352936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.391686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a6196-bd85-47cf-b643-c00477ae55dd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.453424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.454126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.454410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.454686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.455464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:44.455810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.457215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.466362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b26a2-d113-4b16-a586-f347247b1876 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.478743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 386/783] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:44.483832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.502977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.503970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.504474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.505032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.505930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.507509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.513837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 398/784] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:44.647498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:44.666789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df37d2c-74f5-430e-b92c-06e81841edbc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.716520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.717365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.717643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.717917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.731735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.733242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:44.751924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:44.752895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:44.753802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:44.753802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:44.753802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:44.753802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:44.753802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 387/785] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:44.758836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:44.762035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:44.866152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7dd02-70a7-44e8-9273-381419fb0e68 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:44.914736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:44.915470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:44.915751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:44.916015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:44.916804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:44.917102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:44.918491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:44.948308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 399/786] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:44.951874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:45.102020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a132e293-199d-4a2f-996f-a7885c979ed0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:45.142126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:45.142931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.143213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.143473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.157790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:45.159242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:45.161923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:45.175356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:45.176351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:45.177267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 388/787] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:45.182544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:45.316934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:45.375376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad13f9-c26f-4301-8944-b1296a47322e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:45.410660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:45.411765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.412264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.412834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.413932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:45.414434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:45.416113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:45.435155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 400/788] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:45.445251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:45.589871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d7e32-c259-4f24-b74f-310efb879050 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:45.638731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:45.639461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.639735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.640003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.653782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:45.655236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-786ab8e2-dbb9-4812-ba0f-215448a41abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:45.676073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:45.676999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:45.677947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:45.677947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:45.677947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:45.677947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:45.677947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 389/789] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:45.683218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:45.851038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02000b03-3449-4e8a-8a28-f5fe4cfce910 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:45.884510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:45.887135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a641cc0-733e-4d26-b59c-7e04dbe6942a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.887444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a641cc0-733e-4d26-b59c-7e04dbe6942a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.887804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a641cc0-733e-4d26-b59c-7e04dbe6942a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.889342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 390/790] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:45.894895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8848-4f82-4ddb-b5e9-9187530e6bb3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.895251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8848-4f82-4ddb-b5e9-9187530e6bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.895585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e8848-4f82-4ddb-b5e9-9187530e6bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.916065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-975e8848-4f82-4ddb-b5e9-9187530e6bb3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:45.917295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-975e8848-4f82-4ddb-b5e9-9187530e6bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:45.922651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:45.923326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:45.923597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:45.923862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:45.924620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:45.924924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:45.926291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:45.951744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 401/791] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:45.954505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:45.999994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.027829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 391/792] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:51:46.029450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519896b-4996-4572-9abd-bf969d9ea9a5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.029736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519896b-4996-4572-9abd-bf969d9ea9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.030010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519896b-4996-4572-9abd-bf969d9ea9a5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.032217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 392/793] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:46.038305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.038587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.038927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.074072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:46.075992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:46.077953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ebe2e-ccad-4a4d-844d-c9bd0bb591ed None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.117342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.118562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.119081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.119552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.128036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.130036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:46.146086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:46.147026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:46.147929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:46.150784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 402/794] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:46.151987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.168140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 393/795] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:46.168140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.216069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.273537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b11ee6-5509-405d-8a4a-5918a1cb3abf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.276446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c4af-3d7b-4063-8527-908cb5bee4cb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.289175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.311576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.312161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.312280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.312553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.312826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.313005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.313276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.313530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.313633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:46.313941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.315410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02590-3262-4c1a-8c33-bfdd140922db None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.324293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:46.327622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 394/796] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:46.329057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895994-7e9c-4253-8d94-578f4c8de074 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.329478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895994-7e9c-4253-8d94-578f4c8de074 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.329909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20895994-7e9c-4253-8d94-578f4c8de074 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:46.335133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:46.336189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 403/797] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:46.337043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.337787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 395/798] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:46.337787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895994-7e9c-4253-8d94-578f4c8de074 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.441942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.445705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ba77ca-f1db-451d-81dc-5a48eb5bda5a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.447768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20895994-7e9c-4253-8d94-578f4c8de074 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.480648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.481527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.481754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.482021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.487983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.489065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.489347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.489625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/48a2ed589c5742d3acd30e59e9f1da2d/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.491606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=48a2ed589c5742d3acd30e59e9f1da2d, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.492640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:46.493154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bfc05d2d-e018-4f1f-bb88-f8c27036b38c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:46.500362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:46.501511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:46.502361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 404/799] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:46.503037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.503743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.503743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.523955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 396/800] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:46 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/48a2ed589c5742d3acd30e59e9f1da2d/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:46.523955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.524781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:46.526268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:46.569309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.612596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 405/801] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:46.613800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.669139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a9502-2e25-4be6-91bc-0018d56db019 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.715188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.715795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.716075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.716419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.717199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:46.717491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.719296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.728778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 397/802] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:46.729597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.743046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.754242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a8d60-8bd8-4c39-bf2b-882f6fdfa82b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.797375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.798096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.798370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.798639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.799396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:46.799696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.801112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.810151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 406/803] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:46.810978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.854149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:46.863884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25b02f-d973-4881-94b9-5d4339f15a94 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.908604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.909469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.909767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.910043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.911199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.912944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:46.923305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad9df9-c1f9-4c46-8cfd-e155fe37c9ca None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:46.933869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:46.934861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:46.935676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 398/804] 10.222.0.26 () {56 vars in 1129 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:46.936542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:46.968627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:46.970488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:46.971156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:46.971787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:46.983843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:46.985981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:47.005140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:47.006199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:47.007302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:47.007302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:47.007302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:47.007302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:47.013566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 407/805] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:47.014565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.018623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.046268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323952-55cb-4b3f-8cf8-929f1c50ea5d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.083996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.084818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.085095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.085364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.097155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.098820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-57b80bd0-05b4-459b-97f7-6bf37a3cdf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:47.116501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:47.117546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:47.118444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:47.118444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:47.118444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:47.118444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:47.118444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 399/806] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:47.119134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426864c-8409-4822-8449-a34bb54655a1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.119350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426864c-8409-4822-8449-a34bb54655a1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.119624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426864c-8409-4822-8449-a34bb54655a1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.124252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 400/807] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:47.124252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426864c-8409-4822-8449-a34bb54655a1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.128075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f927dd6-3dae-4151-aa77-3c5184dff154 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.136303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.166965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.167875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.168366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.168841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.169693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:47.170136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.172064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.178879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 408/808] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:47.179922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.234092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426864c-8409-4822-8449-a34bb54655a1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.252912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.268060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.268817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.269094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.269362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.270085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:47.270382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.271744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542244ef-c083-41dc-9be4-e3e82d71a37d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.288316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 401/809] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:47.288316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.288316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.288316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.293460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21629a-f35e-412d-b5da-88524ede5d61 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.302886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:47.304188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:47.329509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.330178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.330452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.330712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.331601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:47.331771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.333129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.346385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 409/810] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:47.347191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.373212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.378856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 402/811] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:47.379726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.463503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45a0a-4c05-4d91-875a-361bebc6c83e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.486316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d63d518-d8e6-46c6-9fd7-b27b3a46e4cf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.498521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.508593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.509273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.509685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.509956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.510676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:47.510978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.512419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.521792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 410/812] 10.222.0.26 () {56 vars in 1124 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:47.521792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.528883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.529735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.530409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.530683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.539404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.540873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:47.555795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:47.556772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:47.557725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 403/813] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:47.558307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.620015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.632779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d1934-0640-4dbb-805c-a9e6124843c3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.663286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce2c2a-ff6a-46a2-a587-e7a44a56e7a6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.677798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.678729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.679078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.679499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.687943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.689561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.700549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.701458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.701809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.702150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] PATH_INFO: `/v3/services/network` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.703093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.704570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:47.705291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:47.706345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:51:47.707505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:47.714001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 411/814] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:47.714001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:47.725309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:47.726540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:47.732545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 404/815] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:47.733524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.773548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.826952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82205550-c7c4-4d1d-9862-cc4fb3ea8fd9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.833448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f723b6e-f985-40a3-bad5-86d403abf978 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:47.857962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:47.861706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.862369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.862651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.862925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.863676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.865086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.870531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:47.871203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:47.871484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:47.871756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:47.872639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:47.872955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:47.874375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:47.895399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 412/816] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:51:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:47.895399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:47.895705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 405/817] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:47.895705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.035508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efa81d-4bef-4204-91d3-f29f5483efb4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.040271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.042106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e41c4-1922-4316-8a1d-6f9c908ccd26 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.083835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.084712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.086219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.086329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.086406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.086475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.086562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.086634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.086701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:48.086922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:48.087017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.087170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.088414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.089070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.097669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 406/818] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:48.098478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.111179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 413/819] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:51:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:48.112018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.161387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.219147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d800-d9b1-4558-9aa1-3c5cd74884e2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.222646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0d073-35cd-4e74-969e-9ec1faa3f79f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.255928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.256941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.257223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.257646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.258088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.258769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.259049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.259323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.260039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:48.260375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.261758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.267322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 414/820] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:48.268516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.269994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.272740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:48.290075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:48.291065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:48.293023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:48.293023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:48.293023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:48.293023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:48.296223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 407/821] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:48.297178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.301233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.377020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef64ad2b-fa18-427f-b07d-9dbe812598be None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.405753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.410154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafba7c-b81f-4f7e-9368-bfa320ccbc40 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.413931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.414087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.414331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.414610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.448154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.449060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.449564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.449993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.450972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.452500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.477984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 408/822] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:51:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:48.479158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.504984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.506740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3034dd-0226-48ec-a121-da4dc59bca2f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.574280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.641363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b37be5-170a-48bf-b6f0-aa8a2fc28275 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.681953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.685736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.685736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.685736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.685736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:48.685736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.687432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b5e24-5a09-48e2-99fd-7ea26355cc85 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.695665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 415/823] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:48.697079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f187c-6e1a-4387-9bbc-67ce0cd6d987 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.697438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f187c-6e1a-4387-9bbc-67ce0cd6d987 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.697837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f187c-6e1a-4387-9bbc-67ce0cd6d987 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.699487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 416/824] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:48.706011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 409/825] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:48.706171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f187c-6e1a-4387-9bbc-67ce0cd6d987 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.706268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.706268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.706268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.725714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:48.727864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:48.731842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.808281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 410/826] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:48.808281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.820468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f187c-6e1a-4387-9bbc-67ce0cd6d987 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.850363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.861082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.861971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.862185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.862451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.873239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.874467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:48.892417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:48.893298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 417/827] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:48.894751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:48.926006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074276b-e1fb-4f1d-899e-fea8b64f7171 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:48.965047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:48.965850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:48.966127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:48.966392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:48.973291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:48.974970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:48.977730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:48.989764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:48.990861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 411/828] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:48.991844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.006756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c0332-f987-48d7-bb6c-3d65c321105f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.041577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.042488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.042858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.043152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.054903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:49.062587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:49.063495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 418/829] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:49.064743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.108066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae8295-9940-4539-a4c5-fed2f4ec4066 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.113037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.149439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.150861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.151310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.151747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.153023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.153521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.155613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.169941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 412/830] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:49.175191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.177375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0134cc-a09f-48ae-83a2-34f357077664 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.218183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.219636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.220413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.220880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.222058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.222907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.224984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.236050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.242384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 419/831] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:49.242384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.287620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ea1c3-e713-47b1-8796-dbf446bb003c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.321994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.323224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.323501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.323769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.324634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.324940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.326334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.334949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 413/832] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:49.335812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.343075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.347755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9570f-c7cb-4131-91af-f544e17ddd56 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.381930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.382731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.383011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.383285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.390162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.391624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:49.406436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:49.407300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:49.408210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 420/833] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:49.408694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.448111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916b970-eb67-4f91-9947-c121e7a48337 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.471147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.485027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.486687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.486971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.487244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/97f96a1dea234550944a94d3eaac4aed/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.505497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=97f96a1dea234550944a94d3eaac4aed, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.507635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.514470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1cc3fe-3ba9-462d-91c7-1d9bf61cf64f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.528158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 414/834] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:51:49 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/97f96a1dea234550944a94d3eaac4aed/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:51:49.528158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.556611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.557435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.557714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.558083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.572358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.573852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:49.594519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:49.595666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:49.596865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:49.596865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:49.596865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:49.596865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:49.596865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 421/835] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:49.601814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.619516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.676631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb8629-c7c2-4c51-b2ac-f73c7f55bcf9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.720748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.721510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.721697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.721967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.723532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.723532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.724520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.740152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 415/836] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:49.744003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.746615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dbf183-1e5c-488e-8660-c9b77fbe2322 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.777104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.789688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.790975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.791701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.792186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.793247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.793730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.795951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.814379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 422/837] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:49.815526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:49.873641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e8876-c928-446e-85a7-1b08681af8ca None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.892727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:49.920950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.922303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.923019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.923441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.924739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:49.925063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.926556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:49.929422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee12b0-3495-40fb-a2f2-4d129bc33339 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:49.940146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 416/838] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:49.978197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:49.979017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:49.979292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:49.979558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:49.988412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:49.989946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9c2ae012-f932-44e4-b492-803ec9a3ca1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:50.005997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:50.007051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:50.008062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 423/839] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:51:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:50.015407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.046866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914200-5abb-4ceb-9da3-1d0dfc81581d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.047126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914200-5abb-4ceb-9da3-1d0dfc81581d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.047464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f914200-5abb-4ceb-9da3-1d0dfc81581d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.049080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 424/840] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:50.056952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.057297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.057565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.077499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:50.078904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:50.140154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.149210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a48f5-28dd-471f-b73c-1258e7d62786 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.167415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 425/841] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:50.188964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.194352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.195081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.195362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.195638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.196527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:50.196838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.198565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.219523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 417/842] 10.222.0.26 () {56 vars in 1135 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:50.225914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.264583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.295061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61416dc-6235-4615-b4f6-e29f44f0cc77 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.329401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40440044-c393-4733-8876-20e729a0080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.330388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40440044-c393-4733-8876-20e729a0080d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.330761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40440044-c393-4733-8876-20e729a0080d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.331129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40440044-c393-4733-8876-20e729a0080d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.331885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40440044-c393-4733-8876-20e729a0080d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.333388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40440044-c393-4733-8876-20e729a0080d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-40440044-c393-4733-8876-20e729a0080d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:50.346299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:50.347310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:50.348371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 426/843] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:50.353304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26a220b-08de-4434-b053-69221b66e39e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.354034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40440044-c393-4733-8876-20e729a0080d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.388906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.389567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.389843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.390112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.417390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.458141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40440044-c393-4733-8876-20e729a0080d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.463326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.465308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.483132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.495723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.496534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.497052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.497382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.498162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:50.498612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.500149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.510141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 427/844] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:50.511785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.591529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 418/845] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:50.593264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.624459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d717af64-5127-4a08-8bcf-f9922299148b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.653020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.663010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.664276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.664852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.665326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.666284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:50.666800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.668589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.680441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 428/846] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:50.704793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca6925-f0b8-42d9-9bbe-4ea2ed0ea925 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.744143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.745003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.745286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.745560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.757601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.759080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:50.779532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:50.780501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:50.781382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:50.781382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:50.781382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:50.781382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:50.785671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 419/847] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:50.787071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:50.847248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:50.896419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939baf-ce44-4a04-889a-038047f639f6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:50.940857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:50.941541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:50.941820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:50.942091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:50.942899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:50.943210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:50.944785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:50.962298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 429/848] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:50.964062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:51.066622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09333f3a-8f30-402f-aabf-8eea8bed1729 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:51.074521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:51.102853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:51.103667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.103944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.104246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.111240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:51.112722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:51.126618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:51.127509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:51.128435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:51.132229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 420/849] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:51.134121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:51.245070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69377c0d-d12d-4a0c-b899-79577892fd9c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:51.259107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:51.286584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:51.287259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.287538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.287810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.288707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:51.289019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:51.290474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bd091-b9ac-4d3d-828e-6a475ee7153d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:51.308543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 430/850] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:51.309911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:51.413303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632c1ae-ec02-40d5-aeab-bda2110950bb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:51.447274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:51.447974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.448312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.448589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.449442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=48a2ed589c5742d3acd30e59e9f1da2d) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:51.449753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:51.451200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50ebc3-0cf4-4ce2-a3e0-4e5b42f9a248 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:51.464271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 421/851] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:51 2022] GET /identity/v3/role_assignments?user.id=48a2ed589c5742d3acd30e59e9f1da2d&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:51.587467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644ee5-54e1-46ff-a6bc-34f15be08054 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.588011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644ee5-54e1-46ff-a6bc-34f15be08054 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.588011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec644ee5-54e1-46ff-a6bc-34f15be08054 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.589960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 431/852] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:51.595743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.596049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.596329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.615350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:51.616641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:51.642499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:51.688376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 422/853] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:51.711200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec644ee5-54e1-46ff-a6bc-34f15be08054 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:51.819650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec644ee5-54e1-46ff-a6bc-34f15be08054 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:51.856003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:51.856831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:51.857109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:51.857377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:51.868504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:51.876382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:51.877304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:51.878954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 432/854] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:51:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:51.886601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:51.999107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0565c253-ab2a-4d1b-9394-66781975497b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.035160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.035842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.036137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.036420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.037178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:52.037486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.038937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdc512-aa78-4b5c-989b-ef590aaf822a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.047599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 423/855] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:51:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:52.053131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.087004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.103289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912308-d008-4340-90d4-eda2feed79f7 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.103580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912308-d008-4340-90d4-eda2feed79f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.103875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d912308-d008-4340-90d4-eda2feed79f7 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.105560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 424/856] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:52.110325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.110587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.110853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.127553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:52.128744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:52.152444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.166358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfd49-243f-486b-8c04-38f226c6f39f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.208294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 425/857] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:52.212973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.214149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.214426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.214696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.225498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.227061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.229570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:52.249765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:52.250677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:52.251546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:52.251546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:52.251546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:52.251546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:52.258718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 433/858] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:52.259934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.333924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29b91d-868e-49ad-a028-ba038e5181a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.348975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.367756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1299a-8fd2-4c4c-8e0f-292d50588048 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.372053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.372957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.373241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.373515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.374182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.375560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:52.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:52.389662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:52.390486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:52.394862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 426/859] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:52.396262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.408397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.409336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.409852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.410309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.411244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:52.411734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.413542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.415738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.436297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 434/860] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:52.437563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.516184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ea026-0fe1-40c8-9b8a-e79ea9169e73 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.549338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72116c-e740-4719-9d18-53dc240581b9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.558300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.559209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.559680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.560210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.561115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:52.561606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.563153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.568466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 427/861] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:52.573884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.588401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.589639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.589911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.590178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.599798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.601648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:52.620214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:52.621264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:52.622175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 435/862] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:52.628969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.648529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.674706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.688440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc0705-2823-4f2f-8e75-38a165c75a6e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.723074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.724136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.724639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.725101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.726130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:52.726639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.728271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.734826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 428/863] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:52.750889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e407-73ea-4850-955e-3ccf9cba05a1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:52.788209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:52.788990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.789266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.789533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.790405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:52.790710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:52.792251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba205e-9c25-44e7-9e64-183414b56ad5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:52.812823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 436/864] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:52.818607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:52.834652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a229e9-e95d-47f6-a9cb-547aa04d0947 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.834969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a229e9-e95d-47f6-a9cb-547aa04d0947 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.835216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a229e9-e95d-47f6-a9cb-547aa04d0947 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.837087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 437/865] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:52.843593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:52.843949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:52.844182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:52.863101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:52.864393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:52.941778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:52.952687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 438/866] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:52.974837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.054952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9a41-40f9-4316-b630-5ffabe5635c2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.093448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.094502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.095418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.095897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.108680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d3ad1-1a2e-434c-a9db-aa89a5028ebc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.115489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:53.155500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.156614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.157093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.157556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.158502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.160160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.184177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 439/867] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:51:52 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:51:53.187152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.188941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.298492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 429/868] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:53.305368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.360911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:53.417014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf47a1c-f0b1-4c9a-9481-8c288327fca7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.453070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.453883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.454164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.454436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.465789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.467272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d5694bb5-1498-40ee-969c-a5b3a0356c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:53.485607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:53.486531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:53.487387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:53.487387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:53.487387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:53.487387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:53.487387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 440/869] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:53.492573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.540479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:53.595050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab0152a-ca22-4532-a749-bffcb566b645 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.605212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c964-ac32-4329-b7e8-1e2446abfb19 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.605773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c964-ac32-4329-b7e8-1e2446abfb19 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.605773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953c964-ac32-4329-b7e8-1e2446abfb19 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.607375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 441/870] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:53.612303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.612586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.612861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.629815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:53.630088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.630527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.630807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.631004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:53.631156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.631804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:53.632107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.633545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.645510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 430/871] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:53.651155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.708236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 442/872] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:53 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:51:53.725660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.758223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:53.778403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743b7af-1f36-4175-b46c-8459b56f2bef None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.781488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:53.822767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.823577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.823857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.824260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.831587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.833072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.841504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c601c9-54ac-4260-8b88-14e502f63775 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:53.848638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:53.850421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:53.852618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 431/873] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:53.856728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.882527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:53.883354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:53.884182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:53.884467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:53.885419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:53.887467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:53.903979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:53.906054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:53.907528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:53.916147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 443/874] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:53.916147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:53.986215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5652df2-3fdb-4d1e-98a6-f07367fa2217 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:54.023259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:54.023930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.024237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.024512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.025314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:54.025619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:54.027261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:54.036897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:54.047820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 432/875] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:54.048817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:54.056021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21024a-c624-4882-8dff-2af72f372ccd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:54.079660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:54.102902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:54.104017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.104948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.105556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.106526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:54.107114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:54.108940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:54.115435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 444/876] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:51:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:54.121114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:54.168424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51cbe3-8b95-4374-b002-cc5bc3c343d2 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:54.205459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:54.206222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.206685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.207038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.208727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=97f96a1dea234550944a94d3eaac4aed) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:54.209103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:54.211277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916eb5-0f48-4305-9655-176fa26cabe4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:54.224143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 433/877] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:54 2022] GET /identity/v3/role_assignments?user.id=97f96a1dea234550944a94d3eaac4aed&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:54.245367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29ab60-5992-485b-9832-a102f27f6dfb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:54.283465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:54.284172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.284454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.284724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.285442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:54.285741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:54.287133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072a9bd-02d0-4323-b306-57886c8dcc6e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:54.292916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 445/878] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:51:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:54.825577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280436ee-1d75-4771-8986-6b7289fe023b None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.826094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280436ee-1d75-4771-8986-6b7289fe023b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.826094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280436ee-1d75-4771-8986-6b7289fe023b None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.827773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 434/879] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:54.833040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eddda-4aef-4b19-a73c-537476523a31 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:54.833443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eddda-4aef-4b19-a73c-537476523a31 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:54.833610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eddda-4aef-4b19-a73c-537476523a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:54.850403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b14eddda-4aef-4b19-a73c-537476523a31 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:54.851635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b14eddda-4aef-4b19-a73c-537476523a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:54.868363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:54.918099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 446/880] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:54.940303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280436ee-1d75-4771-8986-6b7289fe023b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:55.031845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:55.045829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280436ee-1d75-4771-8986-6b7289fe023b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:55.079373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:55.079958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.080261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.080527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.081257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:55.082626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fe3f67-60cf-4664-a17b-b19ce4cc81a7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:55.102598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 435/881] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:51:54 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:55.341419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d509-9eef-4642-9d78-3295079b7a82 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.341765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d509-9eef-4642-9d78-3295079b7a82 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.341884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e4d509-9eef-4642-9d78-3295079b7a82 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.343554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 447/882] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:55.348828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.349115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.349394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.366229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:55.367498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:55.448248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 436/883] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:55.465561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d509-9eef-4642-9d78-3295079b7a82 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:55.565841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e4d509-9eef-4642-9d78-3295079b7a82 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:55.600172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:55.600950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.601234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.601508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.602175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:55.603618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:55.615975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:55.617000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:55.617821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:55.622262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 448/884] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:55.623635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:55.698706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:55.725264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1864ba2-0e54-4be8-9f1b-018be8220b5b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:55.760540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:55.761211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.761491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.761763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.762477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:55.762781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:55.764232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:55.773730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 437/885] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:55.775284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:55.800489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:55.877234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a6a6-1f5a-4a3d-a620-eaf8845a32c1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:55.914612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:55.915334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:55.915614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:55.915885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:55.916675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:55.916977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:55.918342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:55.923867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 449/886] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:55.935190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:56.045448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7183eaa-b0c4-43fc-925f-439b877eb76b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:56.084631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:56.085362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.085689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.085963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.086767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] RBAC: Adding query filter params (interface=public, service_id=7cf6c3711a0547398ef5dd392dc2696b, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:56.087077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:56.088792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a3662-4c75-4004-a290-9501af496e72 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:56.094567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 438/887] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:51:55 2022] GET /identity/v3/endpoints?service_id=7cf6c3711a0547398ef5dd392dc2696b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:56.100168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:56.185622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:56.205487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b3055-b47b-4f1f-ad2d-006e432340ea None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:56.239379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:56.240052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.240356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.240624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.241311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:56.242719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bbb0f3-5707-4cb5-810b-91c92f9befcd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:56.248921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 450/888] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:51:56 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:51:56.407372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892faf-5857-42af-a7ba-b75584a93793 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.407691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892faf-5857-42af-a7ba-b75584a93793 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.407928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892faf-5857-42af-a7ba-b75584a93793 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.409596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 439/889] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:56.414793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.415296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.415766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.429639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ff19-d868-473d-9f69-91f122a6ce83 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.429953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ff19-d868-473d-9f69-91f122a6ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.430560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57ff19-d868-473d-9f69-91f122a6ce83 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.431555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 440/890] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:56.436952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.437448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.437567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:56.438027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.438724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:56.443418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:56.461345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:56.462860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:56.515258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 451/891] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:56.535079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 441/892] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:51:56.541868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:56.558751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:56.616954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:56.641985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16806565-2e3f-45a9-9646-0c8f84f7e906 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:56.671024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29917e7-70d9-4525-8d79-ba59e22b05c8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:56.676675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:56.677686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.678108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.678550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.689520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:51:56.698083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:56.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:51:56.699805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:56.702625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 452/893] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:51:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:56.707612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:56.708713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:56.712225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:56.713144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.713980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.714468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.715419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:56.717058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:56.740800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 442/894] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:51:56 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:51:56.843529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26499ff8-cd27-4f8a-9da1-6dbb9b44b677 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:56.884804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:56.894363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:56.895476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:56.895945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:56.896432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:56.897407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:56.897996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:56.899680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:56.911458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 453/895] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:51:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:56.917340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.024715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e01bbb-3076-462a-9143-c6ab2944788a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.059024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.059833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.060110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.060418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.071274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.072854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2e872771-1b5b-48f2-b8b9-31da55d0acf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:57.090312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:57.091252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:57.092597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:57.092597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:57.092597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:57.092597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:57.092597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 443/896] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:57.097599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.184472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc280-f6c7-4ee1-add4-6b569868587a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.185191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc280-f6c7-4ee1-add4-6b569868587a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.185695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc280-f6c7-4ee1-add4-6b569868587a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.187536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 444/897] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:51:57.192669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.193203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.193721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.204278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235e7de-547f-4b38-90d0-682872e77a1e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.215091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:57.216610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:57.248862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.249553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.249830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.250102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.250838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:57.251233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.252654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.269034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 454/898] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:57.270281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.274677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.300368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 445/899] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:51:57.317219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.339092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.393891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ed7ed-69c6-4cc1-ab4c-28bec97a33b4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.438043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.439120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.439795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.440080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.442793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580f512-e614-4939-aa93-5864ee1d858a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.449281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.451295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:51:57.472899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:57.474089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:57.475205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 455/900] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:57.481840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.489465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.490360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.490642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.490918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.491751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.493834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:57.510621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:57.511610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:57.512657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 446/901] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:57.518353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.576350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.599227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba5dc6-6546-49c1-a3ab-907cb7f92583 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.613301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.636716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.637726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.638201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.638665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.639709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:57.640232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.642068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.659271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a2302-df5d-4809-995f-4980aaecfb08 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.665620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 456/902] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:57.666758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.700193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.700890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.701167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.701439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.702173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:57.702462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.704944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.710643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 447/903] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:57.716106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.793415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7b442-6b0c-40b2-9bab-7864792fd78e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.817117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1a8b-154b-41ac-9937-4887b8595910 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:57.818890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.837651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.838233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.838823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.839091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.855765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:57.856782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:57.857249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:57.857704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:57.858621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:57.859127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.860725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.866777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 448/904] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:57.872852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:57.895787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:57.931713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:57.933679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:57.991092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1d4905-0db7-423e-b9d9-3f03459b41c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.025841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.026508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.026770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.027046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.027848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] RBAC: Adding query filter params (interface=public, service_id=7795cd1cef36443783a36e17b5704c86, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:58.028185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.029552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.039176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 449/905] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/endpoints?service_id=7795cd1cef36443783a36e17b5704c86&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:58.040221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.056139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 457/906] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:51:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:51:58.057373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.071240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.133090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.144445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd2a568-5ab4-4a45-a629-3d293ea1efab None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.168330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b676da-4acf-45c4-921d-d349843ee7af None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.179027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.179606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.179885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.180192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.180897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.182292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.196151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 450/907] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:51:58.215866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.216764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.217098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.217424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.230129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.231989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ea5807e9-09aa-4b80-8cc6-d7fcc5343d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:51:58.252151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:58.253107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:58.253987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:51:58.253987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:51:58.253987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:51:58.253987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:58.253987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 458/908] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:58.261248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.329596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d63a-ff87-464e-8143-70293fdd0fd6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.329918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d63a-ff87-464e-8143-70293fdd0fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.330141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4d63a-ff87-464e-8143-70293fdd0fd6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.331789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 459/909] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:58.337442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.337721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.337994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.357521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:58.359257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:58.366889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.376262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff1a0f-061f-477b-9220-3856c989372b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.422370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.423746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.424359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.424852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.426227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:58.426764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.428180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.442166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 451/910] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:58.447865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.448307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 460/911] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:58.470723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.528845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.559410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cbb73-8daf-4595-98d2-ba8d0611c6c8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.582849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f76b3-3266-4967-b098-87b92502691b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.600809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.602450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.602934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.603446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.614022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.616507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.619716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656120-fefe-4427-894c-083738f443ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.620519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656120-fefe-4427-894c-083738f443ae None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.620865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656120-fefe-4427-894c-083738f443ae None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.621218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8656120-fefe-4427-894c-083738f443ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.621951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656120-fefe-4427-894c-083738f443ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.623387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8656120-fefe-4427-894c-083738f443ae None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:51:58.633807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:58.634811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:51:58.635736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a8656120-fefe-4427-894c-083738f443ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:58.636235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:58.637174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 07 03:51:58.638075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:58.646426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 461/913] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:58.646426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656120-fefe-4427-894c-083738f443ae None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.646728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 452/913] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:51:58.648093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.669963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.759583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8656120-fefe-4427-894c-083738f443ae None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.777342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.790093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588b161-916d-4616-9035-5e0ce4416ae9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.797747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.798501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.798851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.799191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.799978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:58.800396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.801905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.812168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 462/914] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:58.813369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.833790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.834748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.835230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.835676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.837245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:58.837741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.840202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc38f9-92d0-4d16-b179-e992176785ce None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.857407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 453/915] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:51:58.859523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8611b-637b-493b-b400-d20903c4972c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.860405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8611b-637b-493b-b400-d20903c4972c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.860995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8611b-637b-493b-b400-d20903c4972c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.863204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 454/916] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:51:58.864710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8611b-637b-493b-b400-d20903c4972c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:58.918587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95019d3e-6f84-477e-92a0-dcb52a3230a0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.952673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:58.957191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:58.957977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.958261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.958534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.959249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:58.959561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:58.961009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097e1a-2c12-4cc8-ac1f-39a86204b13b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:58.966502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 463/917] 10.222.0.26 () {56 vars in 1114 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:58.972512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3078073-775b-475d-aa77-533b177312da None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:58.972803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3078073-775b-475d-aa77-533b177312da None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:58.973080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3078073-775b-475d-aa77-533b177312da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:58.981668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8611b-637b-493b-b400-d20903c4972c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:58.992221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c3078073-775b-475d-aa77-533b177312da None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:51:58.993720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c3078073-775b-475d-aa77-533b177312da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:51:59.018636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.019383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.019495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.019739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.020611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] RBAC: Adding query filter params (role.id=f14abb4b11514ae5980cc2f29d1a5460, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=97f96a1dea234550944a94d3eaac4aed) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:59.020906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.022323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.036160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 455/918] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:51:58 2022] GET /identity/v3/role_assignments?user.id=97f96a1dea234550944a94d3eaac4aed&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=f14abb4b11514ae5980cc2f29d1a5460 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:59.036160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.046868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.084515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 464/919] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:51:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:51:59.105423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3078073-775b-475d-aa77-533b177312da None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.177059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77724a74-ced4-472f-bb36-e4502d268613 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.226019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.227538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.228317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.228786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.230340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.232433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.239720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3078073-775b-475d-aa77-533b177312da None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.242191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.268324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 456/920] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:51:59 2022] POST /identity/v3/endpoints => generated 346 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:51:59.291951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.293197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.293700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.294224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.295145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.296909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:51:59.311938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:51:59.313093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:51:59.313985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:51:59.317145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 465/921] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:51:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:51:59.323844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.438962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf7b360-2280-4458-bc91-8531c68a63d6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.474130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.475186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.475772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.476284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.477192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:59.477700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.479247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.484944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 457/922] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:51:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:59.490761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.526235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.597977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344e33c-5411-4def-8c19-771bef7f7253 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.632832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.633859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.634333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.634796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.635715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:59.636308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.637875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.644633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 466/923] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:51:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:59.652278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.712430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.757273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9304a9-cefb-4410-b570-a815e4de8f94 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.794558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.795237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.795516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.795795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.796663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] RBAC: Adding query filter params (interface=public, service_id=b70c03276e7348b7b5bd9595908d873d, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:51:59.796979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.798358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64516ef2-c14a-4de2-8276-76041e4b4b91 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.804255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 458/924] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:51:59 2022] GET /identity/v3/endpoints?service_id=b70c03276e7348b7b5bd9595908d873d&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:51:59.809446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:51:59.907237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:51:59.911666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242b28-01ea-494d-aba3-81e8a18a7855 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:51:59.954751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:51:59.956219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:51:59.956721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:51:59.957191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:51:59.958070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:51:59.959651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c035da9f-9740-498d-84c3-285defce6886 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:51:59.966835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 467/925] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:51:59 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:52:00.325507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea831e-6235-4248-929d-fcd56fc4209d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:00.326051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea831e-6235-4248-929d-fcd56fc4209d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:00.326051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea831e-6235-4248-929d-fcd56fc4209d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:00.327676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 459/926] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:00.332971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:00.333263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:00.333538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:00.350503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:00.351798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:00.418513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 468/927] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:00.441546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea831e-6235-4248-929d-fcd56fc4209d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:00.550314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea831e-6235-4248-929d-fcd56fc4209d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:00.575649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:00.595600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:00.596469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:00.596748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:00.597018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:00.597816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:00.599196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:00.611901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:00.612975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:00.613883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 460/928] 10.222.0.26 () {56 vars in 1132 bytes} [Thu Jul 7 03:52:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:00.619509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:00.716480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:00.722893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118936a7-a29d-4124-bc1d-0cd7981cd247 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:00.757629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:00.758670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:00.759167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:00.759644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:00.760582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:00.761094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:00.762687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:00.768059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 469/929] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:52:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:00.776149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:00.877572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c859f-4e03-42de-b509-ecfb030968af None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:00.911563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:00.912267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:00.912548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:00.912818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:00.913627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:00.913930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:00.915297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa8f38c-96b4-46e2-8eeb-21354ccc93d2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:00.920647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 461/930] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:52:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:00.926153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.039593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65d4d2-24a4-4012-ace8-25be3fee449c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.079574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.080300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.080581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.080855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.081652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:01.083091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de944c-3f90-4974-a545-b8fe26314a34 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:01.107511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 470/931] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:52:00 2022] POST /identity/v3/endpoints => generated 347 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:01.239752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b745d7-5e87-4122-8400-265ebb852529 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.240354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b745d7-5e87-4122-8400-265ebb852529 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.240779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b745d7-5e87-4122-8400-265ebb852529 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.243146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 462/932] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:01.249244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b880-8e9d-4159-94ff-e1204802cacc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.249897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b880-8e9d-4159-94ff-e1204802cacc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.250393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926b880-8e9d-4159-94ff-e1204802cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.273171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7926b880-8e9d-4159-94ff-e1204802cacc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:01.274756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7926b880-8e9d-4159-94ff-e1204802cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:01.284448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:01.356111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 471/933] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:01.378694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b745d7-5e87-4122-8400-265ebb852529 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.416388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37e8-d0fc-44cb-8699-9bdba6975dd5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.416715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37e8-d0fc-44cb-8699-9bdba6975dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.416932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe37e8-d0fc-44cb-8699-9bdba6975dd5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.418595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 472/934] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:01.423639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.423921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.424227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.434312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:01.441575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:01.442785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:01.501689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b745d7-5e87-4122-8400-265ebb852529 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.520228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 473/935] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:01.536587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.539677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.540984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.541264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.541533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.557740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:01.568661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:01.569796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:01.570641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:01.573880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 463/936] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:01.579892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.614612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:01.651793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d096f-b9ce-4013-8e58-ec719c287fc7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.687511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.688397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.688759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.689129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.689926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:01.691467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:01.693009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING keystone.server.flask.common [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 07 03:52:01.694347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b73735-59b6-485f-9c1c-411440d298ed None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.706175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:01.711605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.sql.core [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 03:52:01.711605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 07 03:52:01.711605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [parameters: {'id': 'a89f62751e8f415f9dbb5603d9ce6a1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 07 03:52:01.711605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a89f62751e8f415f9dbb5603d9ce6a1d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a89f62751e8f415f9dbb5603d9ce6a1d. Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:52:01.729388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 07 03:52:01.730318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application yield resource Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise self.value Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application session.commit() Jul 07 03:52:01.731267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.flush() Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application compat.raise_( Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 03:52:01.732172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 03:52:01.733089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:52:01.733896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [parameters: {'id': 'a89f62751e8f415f9dbb5603d9ce6a1d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.734747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:01.735543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a89f62751e8f415f9dbb5603d9ce6a1d. Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 474/937] 10.222.0.26 () {60 vars in 1140 bytes} [Thu Jul 7 03:52:01 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:01.738309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.746462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.747147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.747422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.747689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.748544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:01.748845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:01.750211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:01.764230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 464/938] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:01.766508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.853485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634dc4dd-d526-4167-9bd4-1b41bd4a1c15 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.878154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:01.879391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31d02c-e180-452d-8e28-d6fdac9e3710 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:01.890786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.891592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.891869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.892167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.899530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:01.901059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:01.915545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:01.916580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:01.917451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 475/939] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:01.922603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:01.925572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:01.932394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:01.932945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:01.933422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:01.951244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:01.953118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:01.972273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:01.973196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:01.974102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:01.974102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:01.974102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:01.974102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:01.980949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 465/940] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:01.982114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.012215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.026150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4369ce7-fb16-4ab7-8460-a88f40cc8fd7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.061899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.062663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.062864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.063110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.063868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:02.064195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.066052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423fd4c-1ed1-4615-a50f-9f4cfc535192 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.087390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 476/941] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:02.089393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57391c-57e7-4338-a49a-ebb16fce52c3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.089723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57391c-57e7-4338-a49a-ebb16fce52c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.090001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d57391c-57e7-4338-a49a-ebb16fce52c3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.091538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 477/942] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:02.095231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04db10-025c-48a8-9095-3cdc33558b1d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.097491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.097641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.097861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.117947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:02.119592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:02.142097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.143643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.144286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.144593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.145394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:02.145706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.147118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.165536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 466/943] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:02.166700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.204522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.226271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 478/944] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:02.250599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.275915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.294979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919fff3-a210-4947-9cbc-e1fa969e3c1b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.337349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.338179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.338757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.339023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.347136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.348722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:02.363837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:02.364952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:52:02.365901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:02.366654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f24ac-2f86-446c-a1bb-8c389e3f54d2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.366729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 467/945] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:02.372446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.403928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.404783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.405061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.405331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.405993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.407496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:02.424142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:02.425136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:02.425951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:02.426661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 479/946] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:02.427656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.471416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.502987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89524a77-446a-43e8-918a-3aa7ad8d092d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.535195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da600e-9f1f-4a55-b172-3d7997bd42b3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.546290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.547209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.547490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.548028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.548929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:02.549235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.551322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.571390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.572072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.572394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.572670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.573397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:02.573700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.574294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 468/947] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:02.575098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.582548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.591626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 480/948] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:02.593479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.595360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.721001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59752a2-5e58-45cc-8492-cddfaa23dbd8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.722692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.734170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23adee94-a46b-4f9a-a758-1033126d5a4f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.758657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.759653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.760019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.760403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.761258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:02.761647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.763158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.768912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 481/949] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:02.774950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.780357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.781167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.781442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.781704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.793105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.794605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:02.814987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:02.815870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:02.817224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:02.817224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:02.817224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:02.817224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:02.817224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 469/950] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:02.822349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:02.889302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:02.891986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef6494-c07b-4383-95fd-2200e5df1a78 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.932477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:02.933313 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:02.933967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:02.939649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:02.940494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:02.941700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e443aa67-68fb-4df4-a569-8a05cf914574 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:02.942096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:02.966632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 482/951] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:52:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:03.002053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.003024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.003509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.003919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.004950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:03.005397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.007028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8b14e-8273-488f-a4cb-91579dd671dc None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.021220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 470/952] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:03.032281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.064604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:03.146088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af619dc-c8df-4593-955f-5e527d29f6e0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.181944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.182754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.182870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600639e4-b433-4f2b-825c-0351de4a6fc1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.183031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.183146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600639e4-b433-4f2b-825c-0351de4a6fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.183294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.183391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600639e4-b433-4f2b-825c-0351de4a6fc1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.184983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 471/953] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:03.189927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.190213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.190553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.190720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.192395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:03.207184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:03.208281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:03.209605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:03.210264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:03.210264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:03.210407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 483/954] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:03.214991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.291232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 472/955] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:03.306996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:03.312909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.326121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff1e39-4338-4ae5-ae50-6849e865d52a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.365492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:03.366268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.367059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.367400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.367745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.369428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:03.369741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.371460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.389183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 484/956] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:52:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:03.390050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.433181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa243f-eaa8-4e42-84e8-e6a33490a13d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.472056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.473046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.473419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.473788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.474551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.476053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:03.488151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:03.489544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:03.490613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:03.497496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 473/957] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:03.498424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.509152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348e4ca-d84c-49ae-903b-5f631f1820c4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.555204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.556383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.557080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.557360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/97f96a1dea234550944a94d3eaac4aed/roles/f14abb4b11514ae5980cc2f29d1a5460` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.560541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=97f96a1dea234550944a94d3eaac4aed, role_id=f14abb4b11514ae5980cc2f29d1a5460)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.562509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.584210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 485/958] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:52:03 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/97f96a1dea234550944a94d3eaac4aed/roles/f14abb4b11514ae5980cc2f29d1a5460 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:52:03.617014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d7ad9-d405-4d02-8ca2-fc2e2338896e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.621070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:03.658747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.659443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.659722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.659992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.660781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:03.661140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.662654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054c1d9-0ee4-4425-8567-b57e12af1cd5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.668845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 474/959] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:03.674807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:03.678129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:03.795012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3cf-d009-473c-8c54-8481a80de3df None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:03.830959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:03.831639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:03.831920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:03.832219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:03.832941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:03.833245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:03.834686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd28b1a-03de-4819-879f-3a488239f546 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:03.840266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 486/960] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:04.257883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711ecd-c261-4a29-8b46-ad7fd7c1ffa8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:04.258252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711ecd-c261-4a29-8b46-ad7fd7c1ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:04.258444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26711ecd-c261-4a29-8b46-ad7fd7c1ffa8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:04.259917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 475/961] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:04.265151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:04.266030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:04.266492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:04.283834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:04.285338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:04.351989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:04.361078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 487/962] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:04.385567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26711ecd-c261-4a29-8b46-ad7fd7c1ffa8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:04.488729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26711ecd-c261-4a29-8b46-ad7fd7c1ffa8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:04.526921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:04.527617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:04.527901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:04.528202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:04.528927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:04.530382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:04.531769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING keystone.server.flask.common [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 07 03:52:04.544934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.sql.core [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 03:52:04.544934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 07 03:52:04.544934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [parameters: {'user_id': 'de26ede7b8ed474f8a39ca850050bd59', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 07 03:52:04.544934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80363) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 07 03:52:04.552756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:52:04.553643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application yield resource Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application next(self.gen) Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.rollback() Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.force_reraise() Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise self.value Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application session.commit() Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 07 03:52:04.554590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._prepare_impl() Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.session.flush() Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._flush(objects) Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application compat.raise_( Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application flush_context.execute() Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rec.execute(self) Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 07 03:52:04.555488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 07 03:52:04.556398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result = self._query(query) Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application conn.query(q) Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application result.read() Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 07 03:52:04.557271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [parameters: {'user_id': 'de26ede7b8ed474f8a39ca850050bd59', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:04.558123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 07 03:52:04.560603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:04.562726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 476/963] 10.222.0.26 () {60 vars in 1131 bytes} [Thu Jul 7 03:52:04 2022] POST /identity/v3/users => generated 160 bytes in 169 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:04.563634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:04.663292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cafee1-1b60-4446-b349-7000d75a60a9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:04.697645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:04.698454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:04.698726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:04.698994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:04.706314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:04.707764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-22b4ad81-c072-4fe9-922f-5a599aa7226d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:04.722894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:04.725086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:04.727353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 488/964] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:04.731432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:04.762791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:04.842129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fb935-315f-4677-9875-31ce69ee51d1 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:04.880302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:04.880986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:04.881267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:04.881541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:04.882403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:04.882708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:04.884454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a8103-090b-4720-94a8-524394d44a8f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:04.923788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 477/965] 10.222.0.26 () {56 vars in 1101 bytes} [Thu Jul 7 03:52:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:05.107826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326656f-c9b2-45c3-b282-e953fd9fae08 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.108004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326656f-c9b2-45c3-b282-e953fd9fae08 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.108373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326656f-c9b2-45c3-b282-e953fd9fae08 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.110074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 489/966] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:05.115573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.116212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.116693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.134617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:05.136506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:05.208155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 478/967] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:05.231617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326656f-c9b2-45c3-b282-e953fd9fae08 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.291473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:05.340023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326656f-c9b2-45c3-b282-e953fd9fae08 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:05.375412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:05.376532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.376994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.377429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.378269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:05.379804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:05.392250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:05.393242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:05.394071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:05.396515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 490/968] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:05.402421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.422315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:05.504292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97adf82b-98c7-4c33-8963-86873e2e7862 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:05.538027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:05.538688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.538976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.539245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.539957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:05.540323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:05.541743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:05.551085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 479/969] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:05.552360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.652527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb84ff5-7188-4f21-8e08-561ad7b883ac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:05.672252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:05.687128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:05.687797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.688066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.688369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.689070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:05.689365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:05.690802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3a2ea-5622-444c-9519-038adb3044d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:05.700410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 491/970] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:05.701682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.769495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca28d6-67ec-4ba1-bd53-48dd32626351 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.769851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca28d6-67ec-4ba1-bd53-48dd32626351 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.770092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca28d6-67ec-4ba1-bd53-48dd32626351 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.771685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 492/971] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:05.776601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.776880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.777148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.788656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:05.794501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:05.795678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:05.812075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6bc69-bcfa-4f35-99da-a43bf68c2a09 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:05.852346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:05.853014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:05.853300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:05.853674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:05.854506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] RBAC: Adding query filter params (interface=admin, service_id=b70c03276e7348b7b5bd9595908d873d, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:05.854804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:05.856315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:05.862230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 480/972] 10.222.0.26 () {56 vars in 1249 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/endpoints?service_id=b70c03276e7348b7b5bd9595908d873d&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:05.867795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.876815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 493/973] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:05.895168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:05.970378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0999f3-447d-48b9-a9cc-99a987c842da None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:05.996909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c1de1-927f-472e-8bbf-97777a599f9b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.003965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.004697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.004973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.005245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.005945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.007436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d97e6e-59d4-43ec-92be-9e8516f36840 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.011577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.014015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 481/974] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 03:52:06.015484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7c60-5d1b-48cc-92f3-b51786b0312a None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.015913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7c60-5d1b-48cc-92f3-b51786b0312a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.016403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ced7c60-5d1b-48cc-92f3-b51786b0312a None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.017871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 482/975] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:06.023605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.023888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.024530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.036827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.037669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.038005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.038282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.044267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:06.045793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:06.049565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.050111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:06.058743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:06.059779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:06.060651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 494/976] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:52:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:06.066457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.131161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 483/977] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:06.155161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.179813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dc1bf-35fd-4b62-b59f-207fff08cd99 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.217929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.218699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.218810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.219037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.219784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:06.220083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.221480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.230143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 495/978] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:06.235641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.264064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455a057-75cc-4a82-8888-bea266ecf980 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.271587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.303588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.304432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.304711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.304982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.305713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.307118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.316550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.325073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 484/979] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:52:06 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:52:06.340410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756abb3-4dcb-4e23-8284-d002412c797b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.385904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.387020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.387300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.387577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.401935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.403518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:06.422453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:06.423576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:06.424608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:06.424608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:06.424608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:06.424608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:06.425514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 496/980] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:06.429662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.545732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcedc64e-8beb-497c-86a6-726157268045 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.580830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.581517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.581790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.582061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.582812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:06.583113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.584525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.597781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 485/981] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:06.603500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.697523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.717122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b46b42-5585-4af5-ba38-2754f2ccf2e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.752412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.753276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.753547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.753815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.761981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.763480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:06.778442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:06.779418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 07 03:52:06.780775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:06.784404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 497/982] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:06.785585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:06.851175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:06.892815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27862ce4-35d6-4971-9445-b71779cd3339 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:06.932403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:06.933085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:06.933359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:06.933623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:06.937025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:06.937025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:06.937025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:06.956194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 486/983] 10.222.0.26 () {56 vars in 1149 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:06.959719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:07.063062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc89d71-af31-4749-af8f-d28437a3e2b0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:07.096987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:07.097676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:07.097961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:07.098230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:07.113533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:07.170447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:07.171934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:07.271968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 498/984] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:06 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:07.277953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:07.380265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0133789-1697-4160-935e-d04bddecaedb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:07.397881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:07.416961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:07.417813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:07.418095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:07.418365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:07.428653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:07.430146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:07.448034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:07.449066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:07.454885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:07.454885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:07.454885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:07.454885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:07.454885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 487/985] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:07.456902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:07.507164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:07.564608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895c3f1-346f-4245-8e66-35e04442e54e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:07.598679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:07.599384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:07.599668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:07.599936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:07.600737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:07.601040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:07.602436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:07.614300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 499/986] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:07.620277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:07.722452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407312be-fdc0-45ce-8e7b-09d2ed962636 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:07.756985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:07.757790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:07.758064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:07.758331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:07.765079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:07.766521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:07.780082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:07.781163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:07.782072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:07.784223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 488/987] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:07.787472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:07.892139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30dbaf4-4d9a-4d58-a365-ce53055444a6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:07.894510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:07.940577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:07.941250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:07.941633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:07.941901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:07.942696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:07.942994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:07.944502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3689da-8ffe-4955-aa5e-ed90d720ace7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:07.962038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 500/988] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:07.963958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.000335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.054550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f96ca-92f4-4bea-be69-5f1d61649e8c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.054835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f96ca-92f4-4bea-be69-5f1d61649e8c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.055137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5f96ca-92f4-4bea-be69-5f1d61649e8c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.056598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 501/989] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:08.061806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7616af-1fd5-485d-960b-5e7804bdb0cc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.062127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7616af-1fd5-485d-960b-5e7804bdb0cc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.062426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7616af-1fd5-485d-960b-5e7804bdb0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.078485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81230b54-1c20-498a-8784-7cedee946ebf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.080241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5b7616af-1fd5-485d-960b-5e7804bdb0cc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:08.081480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5b7616af-1fd5-485d-960b-5e7804bdb0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:08.114125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.114781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.115088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.115325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.116250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] RBAC: Adding query filter params (role.id=f14abb4b11514ae5980cc2f29d1a5460, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=97f96a1dea234550944a94d3eaac4aed) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:08.116558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.118009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.132153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 489/990] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:07 2022] GET /identity/v3/role_assignments?user.id=97f96a1dea234550944a94d3eaac4aed&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=f14abb4b11514ae5980cc2f29d1a5460 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:08.165903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 502/991] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:08.189235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.300838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.306455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425df72-d67a-45ed-8e4f-025e707e719a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.342868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.343694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.344004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.344350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.345037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.351059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:08.371549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:08.372846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:08.373666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 490/992] 10.222.0.26 () {56 vars in 1126 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:08.377168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e649-2399-40e2-8e9d-f4eabe18f336 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.377979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e649-2399-40e2-8e9d-f4eabe18f336 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.377979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e649-2399-40e2-8e9d-f4eabe18f336 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.378503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.379655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 503/993] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:08.384540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.384903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.385247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.402472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:08.403769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:08.476836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 504/994] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:08.493476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b26cd-a9ec-4cee-9e9f-d95b06395c1b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.499298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.527414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.532271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.533488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.533999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.534445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.535232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:08.535570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.537085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.542630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 491/995] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:08.548475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.575164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.618307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657cf02-77aa-41bf-b000-498e51eeef25 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.656379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.657211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.657487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.657678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9284a60-76d6-4e0b-b75e-e9b299120c1b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.657792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.658407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.659845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:08.671612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:08.672854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:08.674086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 505/996] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:08.678869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.698400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.699063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.699340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.699616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.700366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:08.700668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.702028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.707260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 492/997] 10.222.0.26 () {56 vars in 1122 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:08.712792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.775363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.788081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c56d48e-c9c8-452b-8672-e6075578ea16 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.808225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:08.826940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.827546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.827823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.827930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4b4a4-4d11-4d3b-9e8c-590ae3df4708 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:08.828089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.828852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:08.829160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.830589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.835783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 506/998] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:08.841960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:08.867206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:08.868264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:08.868880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:08.869331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:08.870327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:08.871988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:08.889797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 493/999] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:52:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:52:08.974406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a3967-b3c5-4c89-bdda-5e22cedc85b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:09.018801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:09.019509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:09.019787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:09.020034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:09.020847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:09.021151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:09.022661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:09.029129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 507/1000] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:09.035104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:09.145687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd926d-03ae-4f2a-99b1-dcaa1adf2d4f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:09.191857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:09.192858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:09.193259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:09.193644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:09.194926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] RBAC: Adding query filter params (interface=public, service_id=a4efde00e8ad4ee1ac6197adbe4d348f, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:09.195356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:09.197649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d40016-7eea-4648-ae6c-62c23ec3579e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:09.206183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 494/1001] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:52:09 2022] GET /identity/v3/endpoints?service_id=a4efde00e8ad4ee1ac6197adbe4d348f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:09.211981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:09.229259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:09.320323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e0e81-1c6b-415a-aeeb-9e8ac2250034 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:09.354552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:09.355220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:09.355488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:09.355750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:09.356461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:09.357819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943441c4-3885-4dcd-9e1a-be898ad5001a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:09.364401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 508/1002] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:52:09 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:52:10.196471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8770-4a17-401a-8ad4-23960fbd9fc9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:10.196976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8770-4a17-401a-8ad4-23960fbd9fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:10.196976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5c8770-4a17-401a-8ad4-23960fbd9fc9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:10.198475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 495/1003] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:10.203772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:10.204328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:10.204328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:10.222068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:10.223255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:10.293951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 509/1004] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:10 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:10.316017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c8770-4a17-401a-8ad4-23960fbd9fc9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:10.330382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:10.428695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5c8770-4a17-401a-8ad4-23960fbd9fc9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:10.463507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:10.464252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:10.464525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:10.464788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:10.465441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:10.466803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:10.478647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:10.479729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:10.485920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 496/1005] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jul 7 03:52:10 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:10.488105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:10.497092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:10.593349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19312807-fea2-43ba-9b64-be677d793b2f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:10.629213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:10.629924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:10.630203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:10.630476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:10.631197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:10.631570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:10.633022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadbe39a-5794-4bc8-8c4e-9058818ebf57 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:10.643033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 510/1006] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:10.644449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:10.722025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:10.755331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c130d-72a6-4a2f-ac2e-796944ded11d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:10.792750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:10.793447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:10.793694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:10.793985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:10.794707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:10.795004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:10.796435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3093e-565f-4bd6-b652-0c88cf71989c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:10.801546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 497/1007] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:11.074211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf555e-9d9a-4519-8944-12d1df717da9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.074471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf555e-9d9a-4519-8944-12d1df717da9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.074766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf555e-9d9a-4519-8944-12d1df717da9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.076318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 511/1008] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:11.081437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.081723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.081998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.099466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:11.100713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:11.175216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 498/1009] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:11.199055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf555e-9d9a-4519-8944-12d1df717da9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:11.280344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:11.315674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf555e-9d9a-4519-8944-12d1df717da9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:11.353705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:11.354418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.354688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.354956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.356149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:11.357674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c67fa25-e5bf-4576-b6d0-6730a5d43e96 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:11.359545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 512/1010] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:11.365329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:11.439003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:11.480626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44aba5-fb94-4fa5-9751-967b6fe8ca03 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:11.521877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:11.522646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.522925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.523266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.524025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:11.525505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6661225-988d-4acc-927b-4c04b60e4c63 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:11.560147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 499/1011] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:52:11 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:11.735870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab52b-e8d6-4f87-8664-f5547ad6e392 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.736103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab52b-e8d6-4f87-8664-f5547ad6e392 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.736462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ab52b-e8d6-4f87-8664-f5547ad6e392 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.737970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 513/1012] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:11.743470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:11.743763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:11.744038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:11.761783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:11.762978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:11.832744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 500/1013] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:11 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:11.855472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab52b-e8d6-4f87-8664-f5547ad6e392 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:11.966177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ab52b-e8d6-4f87-8664-f5547ad6e392 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:12.001757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:12.002814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.003254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.003680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.004525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:12.006049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:12.018214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:12.019267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 07 03:52:12.020106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:12.020886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 514/1014] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:12.027362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:12.081849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:12.136783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06791167-6a2d-43d5-ab5f-d0845d9fc014 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:12.172719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:12.173663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.174119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.174566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.175488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:12.175965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:12.177520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:12.188210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 501/1015] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:12.190500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:12.193616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:12.296759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a850a8b-20a2-4407-88b9-b94f17857e33 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:12.333737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:12.334839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.335361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.335888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.336845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:12.337410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:12.339485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e026d-d7e9-46f9-b2da-b6343523918e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:12.345122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 515/1016] 10.222.0.26 () {56 vars in 1112 bytes} [Thu Jul 7 03:52:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:12.351304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:12.453970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d6696-d90b-4f00-9cb0-b116b338edeb None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:12.469800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:12.491788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:12.492494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.492772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.493041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.493811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:12.495187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06421aac-2650-49f6-8ef0-55ec6af72dff None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:12.520158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 502/1017] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:52:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:52:12.860643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017bbd-b211-4a3a-8641-540621f42331 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.860896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017bbd-b211-4a3a-8641-540621f42331 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.861156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24017bbd-b211-4a3a-8641-540621f42331 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.862760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 516/1018] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:12.867870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295da1c-9405-45de-868c-8ef1567d2f15 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:12.868147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295da1c-9405-45de-868c-8ef1567d2f15 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:12.868470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c295da1c-9405-45de-868c-8ef1567d2f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:12.885727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c295da1c-9405-45de-868c-8ef1567d2f15 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:12.886922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c295da1c-9405-45de-868c-8ef1567d2f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:12.970232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 503/1019] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:12.993672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017bbd-b211-4a3a-8641-540621f42331 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:13.065732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:13.105776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24017bbd-b211-4a3a-8641-540621f42331 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:13.143882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:13.144953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:13.145455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:13.145984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:13.146927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:13.148607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9cbb2-86a7-4146-886e-87f42e611101 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:13.164820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 517/1020] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:52:12 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 03:52:13.655422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc06fd-7407-4f27-905c-9014d7d06460 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:13.655952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc06fd-7407-4f27-905c-9014d7d06460 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:13.655952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc06fd-7407-4f27-905c-9014d7d06460 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:13.657366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 504/1021] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:13.662859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:13.663295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:13.663393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:13.680021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:13.681227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:13.755419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 518/1022] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:13.781433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc06fd-7407-4f27-905c-9014d7d06460 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:13.877465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:13.885919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc06fd-7407-4f27-905c-9014d7d06460 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:13.919657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:13.920413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:13.920687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:13.920951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:13.922132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:13.923561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b4eed-4d2e-45d8-89af-57a2338d478f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:13.925418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 505/1023] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:13.933074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:13.986330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:14.035758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0292744e-2475-418a-bf41-afe2463459c6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:14.069262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:14.069936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:14.070292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:14.070765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:14.072110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:14.073872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb0622-6dd1-4af4-a1e5-f93c2c4b7789 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:14.098978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 519/1024] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:52:13 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:14.638776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665e850-27b0-4e7d-a0fb-06fdf09b139e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:14.639029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665e850-27b0-4e7d-a0fb-06fdf09b139e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:14.639311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665e850-27b0-4e7d-a0fb-06fdf09b139e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:14.640934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 506/1025] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:14.646135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:14.646397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:14.646953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:14.664764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:14.665967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:14.740842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 520/1026] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:14.764780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665e850-27b0-4e7d-a0fb-06fdf09b139e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:14.877916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665e850-27b0-4e7d-a0fb-06fdf09b139e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:14.914379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:14.915166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:14.915435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:14.915757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:14.926120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:14.935622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:14.936835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:14.941043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 507/1027] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:52:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:14.945843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:14.990317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.054926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be879dca-ef6a-4949-8722-32172dbe00e7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.090333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.091012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.091287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.091553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.092339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.092655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.094061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008ccba-dd80-4b5c-b1c6-09a192abbb0d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.102720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 521/1028] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:15.108241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.136102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.201837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53cd9-cb64-45a4-8ea9-4cd521bd961e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.202059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53cd9-cb64-45a4-8ea9-4cd521bd961e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.202350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53cd9-cb64-45a4-8ea9-4cd521bd961e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.204141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 522/1029] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:15.209144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.209466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.209744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.218523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a3da5-5d66-4a53-80bd-baf279131fbc None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.227258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:15.228564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:15.263543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.264908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.266285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.266797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.280284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.281865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.301422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 523/1030] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:15.301619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:15.302481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:15.303394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:15.303394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:15.303394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:15.303394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:15.307766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 508/1031] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:15.308725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.326409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.342634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.412942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.417126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b89c5-ab3f-454a-99fb-e5c120b27e11 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.438426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5f0c-bb95-4a1e-a29e-d55be4ecbd45 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.457708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.458611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.459075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.459475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.460448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.460756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.462183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.474443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 524/1032] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:15.479680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.479943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.480616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.480891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.481157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.481837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.483234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:15.495273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:15.496508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:15.497482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:15.500438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 509/1033] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:15.502197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.584584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.595639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b51bd24-0c43-4a46-a442-5e7f38944084 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.609790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4476f3b-d3a4-412a-baff-793f6c8741c3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.633251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.634215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.634522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.634786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.643062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.644209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.644733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.645031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.645250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.645564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.646292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.646627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.648273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.653532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 510/1034] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:15.659354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:15.660729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:15.661711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:15.663350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 525/1035] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:15.665384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.668023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.769084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f426d-a07a-49c3-809e-c84b4089cfa6 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.770190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1acf-f40d-493e-ae72-f29015caf322 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.806500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.807194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.807474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.807749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.808082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.808708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.808812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.809039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.809145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.809341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.810110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.810421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.810590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.811799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.821989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 511/1036] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:15.822961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.834287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 526/1037] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:15.840446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.851896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.894348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:15.932204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c2361-f5ae-4979-9c33-aa6054307d6e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.952685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d9eca-5f56-4e16-b327-94626a21adde None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:15.968096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.968822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.969106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.969382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:15.970202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] RBAC: Adding query filter params (interface=public, service_id=427a454ed3774cd7be252b718caf68d7, region_id=RegionOne) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:15.970510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:15.971880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:15.977673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 512/1038] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/endpoints?service_id=427a454ed3774cd7be252b718caf68d7&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:15.982976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:15.996253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:15.997450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:15.997905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:15.998534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.078986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.080519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0ce177-f623-4f3a-aec3-061bc61c8fdc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.090030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2c47a-f732-4201-ba71-ada063f01c39 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.093027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.120998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.125679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.127269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.127923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.128283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.128974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.130451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.137455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 513/1039] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 03:52:16.196387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 527/1040] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:16.202424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.209849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403475-297b-4a2f-a619-c1be2356a1bd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.210109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403475-297b-4a2f-a619-c1be2356a1bd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.210359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14403475-297b-4a2f-a619-c1be2356a1bd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.212064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 528/1041] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:16.218150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.218463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.218704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.236808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:16.238023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:16.319241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 529/1042] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:16.323158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba53b83-97d5-4762-a46a-637522bfe03f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.343534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.360627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.361428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.361712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.362099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.374460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.375940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.385153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:16.393474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:16.394438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:16.395362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:16.395362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:16.395362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:16.395362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:16.395362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 514/1043] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:16.400613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.451408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf1b80-dfd7-4782-8ac3-201c283fef15 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.456785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.495846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.496718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.497007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.497279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.508228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:16.513149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27881589-e0c3-436e-87e4-dca1251fe31b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:16.516093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:16.517270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:16.518333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 530/1044] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:16.523420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.552611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.553307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.553584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.553902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.554589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:16.554892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.556439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.573596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 515/1045] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:16.575362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.635905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.641646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12ba27-ac64-4d61-85ca-c9739e957ee5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.677910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.679348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.679792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.680066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.680898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:16.681207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.682602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.691074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 531/1046] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:16.692050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85629af8-e55b-4dbd-aee3-fcf5054b6fb8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.696893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.705147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.734055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641220-2706-4889-9947-5191c0385931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.735014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641220-2706-4889-9947-5191c0385931 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.735916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641220-2706-4889-9947-5191c0385931 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.735916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641220-2706-4889-9947-5191c0385931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.743163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f641220-2706-4889-9947-5191c0385931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.744709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f641220-2706-4889-9947-5191c0385931 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6f641220-2706-4889-9947-5191c0385931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:16.759324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:16.760489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:16.761425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 516/1047] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:16.766442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641220-2706-4889-9947-5191c0385931 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.811308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1b327-b069-4503-802e-fc3dada33051 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.848806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.850352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.850717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.850994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] PATH_INFO: `/v3/users/3e0d982f943d4f2da44c78604a2ba102` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.866373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0d982f943d4f2da44c78604a2ba102)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.868017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.870049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 532/1048] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/users/3e0d982f943d4f2da44c78604a2ba102 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:16.875738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.879904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641220-2706-4889-9947-5191c0385931 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.895960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:16.924106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:16.924953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:16.925263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:16.925561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:16.930250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:16.930617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:16.932186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:16.949958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 517/1049] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:16.955733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:16.985823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfbcd0-4868-45e8-af58-2e9639da74d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:16.986258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:17.023410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:17.024156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:17.024437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:17.024744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:17.065895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2ad4f-2fe2-4394-a68d-47519a364bec None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:17.102902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:17.103886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:17.104400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:17.104867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:17.106002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] RBAC: Adding query filter params (role.id=f14abb4b11514ae5980cc2f29d1a5460, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:17.106551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:17.108381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:17.110275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:17.111794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:17.115667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 518/1050] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=f14abb4b11514ae5980cc2f29d1a5460 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:17.137543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:17.236498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 533/1051] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:16 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 03:52:17.242748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:17.347045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:17.357406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9f65-bb8d-45f1-8454-8bfbaae8fd2e None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:17.392374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:17.393257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:17.393530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:17.393817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:17.395021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:17.396530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eafaa20-a399-4b23-b9da-83787190c731 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:17.398563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 519/1052] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:17 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:17.404528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:17.507344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f741597-e365-4f19-be98-a9849a3cff48 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:17.525034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:17.543441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:17.544148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:17.544433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:17.544701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:17.545581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=f707dd9319dd4643a305b290eec405a9, user.id=3e0d982f943d4f2da44c78604a2ba102) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:17.545889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:17.547343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8496a61-a0f6-4016-a70e-6b176cbc3943 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:17.560157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 534/1053] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:17 2022] GET /identity/v3/role_assignments?user.id=3e0d982f943d4f2da44c78604a2ba102&scope.project.id=f707dd9319dd4643a305b290eec405a9&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:18.207102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9716d-f20f-4767-aeab-cd3f3a493009 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.207635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9716d-f20f-4767-aeab-cd3f3a493009 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.207635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9716d-f20f-4767-aeab-cd3f3a493009 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.209311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 520/1054] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:18.215467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.215942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.216014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.234492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:18.235669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:18.305951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 535/1055] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:18.328351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9716d-f20f-4767-aeab-cd3f3a493009 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:18.428469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9716d-f20f-4767-aeab-cd3f3a493009 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:18.461062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:18.461802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.462063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.462326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] PATH_INFO: `/v3/services/image` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.463353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:18.464771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:18.476441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:18.477901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 07 03:52:18.478878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:18.483101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 521/1056] 10.222.0.26 () {56 vars in 1105 bytes} [Thu Jul 7 03:52:18 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:18.485022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:18.594904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173ba37-1071-41f8-af77-f02e712efa21 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:18.608546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:18.633249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:18.634213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.634496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.634770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.635527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:18.635834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:18.637306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:18.643413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 536/1057] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:18.649488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:18.677487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:18.757885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7c5d0-b28d-4fa2-a668-66453ee48974 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:18.792701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:18.793368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.793644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.793911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.794627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] RBAC: Adding query filter params (type=image) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:18.794930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:18.796322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c1da5-014c-40dc-bc3b-c9fd78ee8e19 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:18.801483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 522/1058] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:18.807233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:18.908832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd93d29-134f-45d1-b2e7-d860cce80f31 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:18.948040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:18.948958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:18.949235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:18.949504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:18.950299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:18.951750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ff0a51-b85c-4844-a7ea-f5042320b8d4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:18.971924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 537/1059] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:52:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:19.127652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b23d-c84f-4b75-acf2-fdfbc58583fa None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.127906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b23d-c84f-4b75-acf2-fdfbc58583fa None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.128178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073b23d-c84f-4b75-acf2-fdfbc58583fa None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.129727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 523/1060] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:19.134984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.135271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.135562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.153632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:19.154816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:19.181307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:19.230883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 538/1061] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:19.253160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073b23d-c84f-4b75-acf2-fdfbc58583fa None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.344460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:19.358754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073b23d-c84f-4b75-acf2-fdfbc58583fa None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:19.392264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:19.393030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.393304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.393570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.404458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ff53ad19-b6fe-4c9e-a3cc-0312f276f98a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:19.412601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:19.413569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:19.414416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:19.416225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 524/1062] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:19.420154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.524469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ed1c3-8cde-4269-a75a-6227d131bf06 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:19.559574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:19.560298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.560575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.560845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.561705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:19.562012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:19.563404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:19.568284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0ede-634f-4b4d-bfb7-02c596060513 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.569169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0ede-634f-4b4d-bfb7-02c596060513 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.569457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156c0ede-634f-4b4d-bfb7-02c596060513 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.570969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 525/1063] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:19.572168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 539/1064] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:19.576349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.576652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.576924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.577412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.596730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:19.598410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:19.602010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:19.673638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 526/1065] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:19.685804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4450e-6ea3-4aee-9e50-40720d84ca22 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:19.695802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.720355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:19.721442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.721917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.722351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.735429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:19.736948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:19.754927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:19.756100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:19.757379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:19.757379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:19.757379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:19.757379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:19.757379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 540/1066] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:19.761777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.785132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:19.810660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed610d-a13c-4e46-a9a3-4c6ce002cfc0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:19.833632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:19.850043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:19.851066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.851342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.851600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.862461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:19.867954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8593b1f5-3ef2-411b-92e3-aed50f8bf424 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:19.870117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:19.871049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:19.871909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 527/1067] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:19.877514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.907171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:19.908068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:19.908201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:19.908414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:19.909149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:19.909455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:19.910847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:19.929026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 541/1068] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:19.929985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:19.988071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5bb95-9114-4b12-b67d-c52d0bfe8cba None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.025768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.026439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.026716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.026979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.027733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:20.028035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.029449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.035020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.044021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 528/1069] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:20.045069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.046409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b2c1a-1bad-4d97-9cea-e41c6415b78f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.076980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.082778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.083597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.084228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.084504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.092929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.094439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:20.111299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:20.112624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:20.113987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 542/1070] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:52:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:20.118299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.153591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaafbbc-c0da-4de9-9e8b-a6a9040418f7 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.188538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.189484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.189611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.189866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] PATH_INFO: `/v3/users/3e0d982f943d4f2da44c78604a2ba102` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.191063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0d982f943d4f2da44c78604a2ba102)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.192591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.194255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 529/1071] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/users/3e0d982f943d4f2da44c78604a2ba102 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:20.199921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.230841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ec29a-53e8-4578-b98c-1269ff1c056a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.273342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.274387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.274757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.274757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.275029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.276168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:20.276510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.278392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.295540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 543/1072] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:20.301129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.313164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d8c32f-2ecd-4613-a2b5-aacf03b574a3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.350527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.355547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.356475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.356760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.357034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.358222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.359660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.361578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 530/1073] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:20.368557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.402238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f359c-2143-4270-af99-530c688edfc5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.436735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.437648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.437911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.438218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.449283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.450490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:20.468809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:20.469718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:20.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:20.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:20.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:20.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:20.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 544/1074] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:20.474815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63aff7-88ec-4a61-a88a-e5005d465d5c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.475542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.512792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.514066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.514558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.515045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9/users/3e0d982f943d4f2da44c78604a2ba102/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.517325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] RBAC: Authorizing `identity:create_grant(project_id=f707dd9319dd4643a305b290eec405a9, user_id=3e0d982f943d4f2da44c78604a2ba102, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.518979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.522417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.536169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 531/1075] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:52:20 2022] PUT /identity/v3/projects/f707dd9319dd4643a305b290eec405a9/users/3e0d982f943d4f2da44c78604a2ba102/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 03:52:20.589092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeaded0-383a-4b38-925d-305142b9f51b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.590867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:20.629185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.629859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.630139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.630416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.631220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:20.631541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.632982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.645949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 545/1076] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:20.651983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.765331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1805270-3f29-4702-9b94-b9a3233e6176 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.801813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.803003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.803480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.803921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.811195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.812871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:20.827046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:20.827937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:20.828883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:20.834452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 532/1077] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:20.836147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:20.947943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5a201-9d92-470c-be18-b512fc5798a0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:20.984246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:20.984944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:20.985229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:20.985502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:20.986306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:20.986617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:20.988080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a3f17-4c8c-4f39-8b7a-2f0c95dc488a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:21.006005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 546/1078] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:52:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:21.007615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:21.021248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ffb6-f5c2-46af-8599-96569579f63f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.021579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ffb6-f5c2-46af-8599-96569579f63f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.021747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ffb6-f5c2-46af-8599-96569579f63f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.023135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 547/1079] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:21.028089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.028397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.028667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.046709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:21.047938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:21.065433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:21.072239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:21.119387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 548/1080] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:21.121083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a63ea-445d-4fea-bd05-ce1994e52671 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:21.141278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:21.159665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:21.160983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.161593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.161927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/f14abb4b11514ae5980cc2f29d1a5460` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.164424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=2bd030577928438b940c477cb4fc2456, role_id=f14abb4b11514ae5980cc2f29d1a5460)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:21.166017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:21.181271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 533/1081] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:52:21 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/2bd030577928438b940c477cb4fc2456/roles/f14abb4b11514ae5980cc2f29d1a5460 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:52:21.247102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfef2e-8d42-490d-9118-570ae3c05624 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:21.284412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:21.285093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.285377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.285647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.308839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:21.361678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:21.363156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:21.461785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 549/1082] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 03:52:21.468172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:21.570284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f6dc-adc8-45be-bcda-9590d8546b6f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:21.586434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:21.606810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:21.607616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.607896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.608189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.619060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:21.620554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-7854017a-3a20-4e78-9762-07c671ecc1e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:21.638676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:21.639673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:21.640993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:21.640993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:21.640993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:21.640993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:21.644232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 534/1083] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:21.646589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:21.703420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:21.755118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268c7b8-0912-421f-ba87-7e835483cbdf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:21.790221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:21.790881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:21.791137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:21.791436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:21.792149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:21.792480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:21.793880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be832db9-3f3a-4212-ac1d-3d55537cec8e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:21.812205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 550/1084] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:22.545878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbbc2-0928-484f-b9ea-6f978f3c605d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:22.546484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbbc2-0928-484f-b9ea-6f978f3c605d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:22.546484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cbbbc2-0928-484f-b9ea-6f978f3c605d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:22.547815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 535/1085] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:22.553117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442816f-137c-4184-9557-413caa96aa17 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:22.553552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442816f-137c-4184-9557-413caa96aa17 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:22.553659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442816f-137c-4184-9557-413caa96aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:22.570638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c442816f-137c-4184-9557-413caa96aa17 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:22.571790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c442816f-137c-4184-9557-413caa96aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:22.641502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 551/1086] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:22.664638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbbc2-0928-484f-b9ea-6f978f3c605d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:22.774376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cbbbc2-0928-484f-b9ea-6f978f3c605d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:22.809826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:22.810545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:22.810819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:22.811089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:22.822453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:22.833469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:22.834439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:22.835263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:22.835895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 536/1087] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:22.842955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442816f-137c-4184-9557-413caa96aa17 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:22.889811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:22.953553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442816f-137c-4184-9557-413caa96aa17 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:22.989996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:22.990729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:22.991009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:22.991284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:22.992043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:22.992386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:22.993771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.002157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 552/1088] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:23.008179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.036911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.108499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c02c7-8190-467d-b19f-740a5e8b3423 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.143395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.144307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.144583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.144851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] PATH_INFO: `/v3/users/3e0d982f943d4f2da44c78604a2ba102` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.146100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] RBAC: Authorizing `identity:get_user(user_id=3e0d982f943d4f2da44c78604a2ba102)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.147766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dab074-445f-4dc1-a072-53128aa26996 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.154263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 537/1089] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/users/3e0d982f943d4f2da44c78604a2ba102 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:23.155577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.202217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a87a-0d78-468c-8a41-4b9ae2a4c5f2 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.202498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a87a-0d78-468c-8a41-4b9ae2a4c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.202769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567a87a-0d78-468c-8a41-4b9ae2a4c5f2 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.204198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 538/1090] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:23.209132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.209410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.209678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.227471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:23.228694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:23.257916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284656a6-a1f1-4031-91b6-1b624c6e445c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.260215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.293328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 539/1091] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:23.293642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.294327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.294605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.294907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.316573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.343444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.363410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.364848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.413968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9aae3-140c-4200-9eca-28c9e606bb53 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.449105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.449917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.450192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.450495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.460657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 553/1092] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:23.466155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:23.466952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:23.469204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:23.470128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 07 03:52:23.471013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:23.471665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.471737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 540/1093] 10.222.0.26 () {56 vars in 1120 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:23.476555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.569127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.580557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bdd41-6444-476f-8c8f-1036cb2ff8d8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.585211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fc1a2-33de-4b30-a38a-f5a1c8d34e6f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.615640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.616490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.616769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.617043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.618262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.619732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.619946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.620668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.620947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.621216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.621542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 554/1094] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:23.621998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:23.622297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.623646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.627638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.631962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 541/1095] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:23.637467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.697290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.728092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed615-54f1-462f-835a-2913d7f4621f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.737753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed76d47-9f87-47e9-b5e4-b8787ebb3059 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.761030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.761691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.761971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.762256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.763079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=f707dd9319dd4643a305b290eec405a9, user.id=3e0d982f943d4f2da44c78604a2ba102) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:23.763386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.764873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.770452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.770787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 555/1096] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/role_assignments?user.id=3e0d982f943d4f2da44c78604a2ba102&scope.project.id=f707dd9319dd4643a305b290eec405a9&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:23.771358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.771671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.772022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.783473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.784986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.794514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:23.805118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:23.806114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:23.806987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:23.806987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:23.806987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:23.806987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:23.811967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 542/1097] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:23.812858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:23.934169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d646c999-9333-4bb2-b4cc-1732a0313ae8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:23.970660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:23.971330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:23.971604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:23.971874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:23.972651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:23.972939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:23.974348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:23.976811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:23.987421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 556/1098] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:23.993644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:24.095944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c4e99-f35f-4140-a94c-4517bbf3dda0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:24.129178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:24.129984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:24.130261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:24.130522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:24.138286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:24.139722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:52:24.154200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:24.155332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:24.161368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 543/1099] 10.222.0.26 () {56 vars in 1093 bytes} [Thu Jul 7 03:52:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:24.163650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:24.266769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddbb9db-84b9-4be3-b76e-d50fb4897cb5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:24.302949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:24.303631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:24.303908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:24.304197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:24.305056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:24.305359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:24.306803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:24.324370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 557/1100] 10.222.0.26 () {56 vars in 1133 bytes} [Thu Jul 7 03:52:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:24.330147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:24.393523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:24.435805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c10a5-ddcd-42ff-aad6-68400f27575f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:24.471450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:24.472108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:24.472495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:24.472758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:24.541543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:24.542996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:24.601105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:24.642939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 544/1101] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:24.649441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:24.704861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:24.749599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c8005-f4c6-4480-90f0-1b19a761c4dc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:24.786077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:24.786880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:24.787260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:24.787531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:24.798058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:24.799453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:24.816915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:24.817899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:24.818863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:52:24.818863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:24.818863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:52:24.818863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:24.818863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 558/1102] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:52:24.823974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:24.927304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f6422-ac4f-41f5-a6cc-3e7cdef772a0 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:24.967777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:24.968476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:24.968755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:24.969026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:24.969759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:24.970072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:24.971467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:24.982925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 545/1103] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:24.988848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:25.092571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298678da-cb2e-4ed0-b06a-29911444ad11 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:25.100221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:25.127298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:25.128090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:25.128392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:25.128661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:25.135221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:25.136701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:52:25.150184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:25.151217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:25.152133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 559/1104] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:25.157242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:25.180357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:25.257675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0fd0f-74d8-4a4a-8402-9da9aead20d3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:25.292035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:25.292730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:25.293009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:25.293265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:25.294062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:25.294369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:25.295801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7a75-c423-4de9-99e3-1ff473ade4a2 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:25.308083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 546/1105] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:25.314222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:25.418692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca2188-43b2-44ad-95d6-daa1326c91bd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:25.453310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:25.454067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:25.454345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:25.454615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:25.455448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] RBAC: Adding query filter params (role.id=f14abb4b11514ae5980cc2f29d1a5460, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=2bd030577928438b940c477cb4fc2456) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:25.455757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:25.457249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666495-67cf-4480-9d83-edc56332e176 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:25.463794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 560/1106] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:25 2022] GET /identity/v3/role_assignments?user.id=2bd030577928438b940c477cb4fc2456&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=f14abb4b11514ae5980cc2f29d1a5460 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:25.807822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b1c4-95d6-4a85-ba58-f36bf85df3ca None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:25.808413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b1c4-95d6-4a85-ba58-f36bf85df3ca None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:25.808413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886b1c4-95d6-4a85-ba58-f36bf85df3ca None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:25.809771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 547/1107] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:25.815282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:25.815749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:25.815950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:25.834198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:25.835368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:25.861068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:25.909400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 561/1108] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:25.933740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b1c4-95d6-4a85-ba58-f36bf85df3ca None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:26.018199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:26.039042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886b1c4-95d6-4a85-ba58-f36bf85df3ca None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:26.072956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:26.073696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:26.073979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:26.074254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:26.075451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:26.076925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f74a753-743b-49c8-b2d3-293d0ae7f0f6 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:26.078740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 548/1109] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:26.084550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:26.183562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75284b5e-0f63-45c4-828b-d0ae6ebf77c9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:26.217523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:26.218206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:26.218485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:26.218764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:26.219493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:26.220976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bdbc8e-807e-4f30-81df-6a47f33b637a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:26.242502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 562/1110] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:52:26 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:28.275317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adb220-3413-493b-a86a-40a38de94c71 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:28.276109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adb220-3413-493b-a86a-40a38de94c71 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:28.276109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74adb220-3413-493b-a86a-40a38de94c71 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:28.278200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 549/1111] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:28.283633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:28.284055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:28.284473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:28.307716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:28.308934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:28.321396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:28.385069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 563/1112] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:28.408511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adb220-3413-493b-a86a-40a38de94c71 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:28.515165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74adb220-3413-493b-a86a-40a38de94c71 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:28.550328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:28.551114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:28.551390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:28.551649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] PATH_INFO: `/v3/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:28.553238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] RBAC: Authorizing `identity:get_role(role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:28.554620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:28.555974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 550/1113] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:28 2022] GET /identity/v3/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:28.565523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:28.675031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916eee-df49-4ea6-b597-17763eddc25c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:28.717591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:28.718468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:28.718743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:28.719012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] PATH_INFO: `/v3/users/b102c59bef73497ba55d2cd56c3a1292` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:28.733007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] RBAC: Authorizing `identity:get_user(user_id=b102c59bef73497ba55d2cd56c3a1292)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:28.734480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:28.736151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 564/1114] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:28 2022] GET /identity/v3/users/b102c59bef73497ba55d2cd56c3a1292 => generated 286 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:28.742454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:28.762478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:28.848015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0772f78-21ee-4468-9e8b-26af5af933d3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:28.884316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:28.884980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:28.885258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:28.885525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:28.955888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:28.957465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:28.975003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:29.063676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 551/1115] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:29.070005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:29.074290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:29.176403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a56db-4cca-49b4-b94b-a4e72fba09d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:29.211008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:29.211872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:29.212157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:29.212442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:29.214017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:29.215466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f0644-9ce8-4118-a07b-554e80d98721 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:29.217198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 565/1116] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:29 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:29.223605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:29.342821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0b42b-2b92-4a5a-be23-af2d4e59ef4c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:29.359464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:29.386008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:29.386685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:29.386936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:29.387216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:29.388059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=f707dd9319dd4643a305b290eec405a9, user.id=b102c59bef73497ba55d2cd56c3a1292) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:29.388399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:29.389861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825827c-7130-495f-9715-ce8082d64861 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:29.395472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 552/1117] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:29 2022] GET /identity/v3/role_assignments?user.id=b102c59bef73497ba55d2cd56c3a1292&scope.project.id=f707dd9319dd4643a305b290eec405a9&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:31.381227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a138c-2db5-481b-9841-fb89641c9621 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:31.381831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a138c-2db5-481b-9841-fb89641c9621 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:31.381945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a138c-2db5-481b-9841-fb89641c9621 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:31.384012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 566/1118] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:31.392030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:31.392524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:31.392625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:31.411800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:31.413029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:31.484107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 553/1119] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:52:31.515232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a138c-2db5-481b-9841-fb89641c9621 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:31.591141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:31.623793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a138c-2db5-481b-9841-fb89641c9621 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:31.659158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:31.659937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:31.660259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:31.660519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] PATH_INFO: `/v3/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:31.662186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] RBAC: Authorizing `identity:get_role(role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:31.663582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:31.665015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 567/1120] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:31 2022] GET /identity/v3/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:31.671680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:31.782791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de615a-0f33-4c1b-a48b-15b95b6bc246 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:31.794834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:31.823572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:31.824505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:31.824783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:31.825054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] PATH_INFO: `/v3/users/b102c59bef73497ba55d2cd56c3a1292` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:31.826267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] RBAC: Authorizing `identity:get_user(user_id=b102c59bef73497ba55d2cd56c3a1292)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:31.827715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:31.829457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 554/1121] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:31 2022] GET /identity/v3/users/b102c59bef73497ba55d2cd56c3a1292 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:31.839697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:31.958000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96449443-6ec3-416f-94e0-31451877a25b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:31.992900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:31.993763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:31.994038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:31.994307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:31.995636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:31.997141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a70f7-9470-40ee-bf24-12225cd3eb66 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:31.998857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 568/1122] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:31 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:32.010375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:32.132147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b73f8a-7919-4d08-80aa-c7507a8c1799 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:32.168152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:32.169075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:32.169351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:32.169623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9/users/b102c59bef73497ba55d2cd56c3a1292/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:32.172042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] RBAC: Authorizing `identity:create_grant(project_id=f707dd9319dd4643a305b290eec405a9, user_id=b102c59bef73497ba55d2cd56c3a1292, role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:32.173550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b364b175-ef7e-43c1-8e38-18ab01769d23 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:32.190695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 555/1123] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:52:32 2022] PUT /identity/v3/projects/f707dd9319dd4643a305b290eec405a9/users/b102c59bef73497ba55d2cd56c3a1292/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:52:34.166422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c6bf-0c3d-47cf-9d3e-58e2c8f5d51c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:34.167307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c6bf-0c3d-47cf-9d3e-58e2c8f5d51c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:34.167307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0c6bf-0c3d-47cf-9d3e-58e2c8f5d51c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:34.169613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 569/1124] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:34.174998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:34.175434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:34.175530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:34.194952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:34.196077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:34.227894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:34.266895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 556/1125] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:34.291081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0c6bf-0c3d-47cf-9d3e-58e2c8f5d51c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:34.306246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:34.421945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0c6bf-0c3d-47cf-9d3e-58e2c8f5d51c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:34.457105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:34.457889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:34.458163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:34.458508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] PATH_INFO: `/v3/roles/c5678ef8643e4fb09152ebe76b4213ad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:34.459977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] RBAC: Authorizing `identity:get_role(role_id=c5678ef8643e4fb09152ebe76b4213ad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:34.461427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:34.463175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 570/1126] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:34 2022] GET /identity/v3/roles/c5678ef8643e4fb09152ebe76b4213ad => generated 223 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:34.469249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:34.569676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb953e-8835-4df2-bcfe-791dd6f15cc7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:34.604927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:34.605782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:34.606053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:34.606313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] PATH_INFO: `/v3/users/b102c59bef73497ba55d2cd56c3a1292` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:34.607598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] RBAC: Authorizing `identity:get_user(user_id=b102c59bef73497ba55d2cd56c3a1292)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:34.609051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:34.610680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 557/1127] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:34 2022] GET /identity/v3/users/b102c59bef73497ba55d2cd56c3a1292 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:34.617134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:34.700790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:34.725991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccaf96e-d31a-4c3e-a431-ab23cbe7fb04 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:34.761611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:34.762264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:34.762539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:34.762812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:34.831206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:34.832697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:34.908320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:34.931705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 571/1128] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:34.937896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:34.974678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:35.043000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e77f3-ac6f-46ee-9245-620a063c17d9 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:35.083058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:35.084145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:35.084422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:35.084690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] PATH_INFO: `/v3/projects/f707dd9319dd4643a305b290eec405a9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:35.086031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] RBAC: Authorizing `identity:get_project(project_id=f707dd9319dd4643a305b290eec405a9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:35.087829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93a0362-9b7b-426c-b4d3-996f4ebe9d7c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:35.089609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 558/1129] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:34 2022] GET /identity/v3/projects/f707dd9319dd4643a305b290eec405a9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:35.095975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:35.198675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5bcff-1e7b-48bf-9880-600e02150dea None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:35.234967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:35.235618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:35.235890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:35.236164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:35.237015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] RBAC: Adding query filter params (role.id=c5678ef8643e4fb09152ebe76b4213ad, scope.project.id=f707dd9319dd4643a305b290eec405a9, user.id=b102c59bef73497ba55d2cd56c3a1292) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:35.237308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:35.238746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb5975e-1d21-41a4-8211-b546b236a76f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:35.244660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 572/1130] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:35 2022] GET /identity/v3/role_assignments?user.id=b102c59bef73497ba55d2cd56c3a1292&scope.project.id=f707dd9319dd4643a305b290eec405a9&role.id=c5678ef8643e4fb09152ebe76b4213ad => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:37.253190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d7db-1a97-4488-956e-e1a463697741 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:37.253993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d7db-1a97-4488-956e-e1a463697741 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:37.253993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480d7db-1a97-4488-956e-e1a463697741 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:37.256176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 559/1131] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:37.261550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:37.261999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:37.262102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:37.280745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:37.281910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:37.317309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:37.356561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 573/1132] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:37.380102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d7db-1a97-4488-956e-e1a463697741 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:37.497483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480d7db-1a97-4488-956e-e1a463697741 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:37.499814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:37.535691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:37.536567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:37.536842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:37.537114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:37.538335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:37.539775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e5ee4-9810-4907-988e-0c0edce134ea None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:37.541442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 560/1133] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:37.548338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:37.660922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a6098-6083-423f-91f9-c68d8495d523 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:37.696277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:37.696943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:37.697221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:37.697491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:37.698205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:37.699654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fed4b0-70d3-48c3-87c1-7622a5b0c7df None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:37.728897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 574/1134] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:52:37 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:39.761663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4108-62b2-4086-a868-a7aa23365248 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:39.762555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4108-62b2-4086-a868-a7aa23365248 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:39.762555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5b4108-62b2-4086-a868-a7aa23365248 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:39.764840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 561/1135] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:39.773420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:39.774126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:39.774280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:39.796477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:39.797665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:39.814797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:39.869139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 575/1136] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:39.893613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4108-62b2-4086-a868-a7aa23365248 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:40.005005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5b4108-62b2-4086-a868-a7aa23365248 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:40.040156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:40.040954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:40.041228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:40.041497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:40.042796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:40.044265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ec51-0143-4d7f-a95b-267e4971e624 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:40.045881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 562/1137] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:52:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:40.052661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:40.159617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f61921-38a6-429e-a6e9-cd675cb7871f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:40.194337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:40.194991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:40.195262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:40.195531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:40.196271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:40.197700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca5791-345c-4b7d-bd7d-c55c7336fe88 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:40.220899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 576/1138] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:52:40 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:42.261075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f9cc-2203-4278-bd53-f7640e3a5466 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:42.261906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f9cc-2203-4278-bd53-f7640e3a5466 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:42.261906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b8f9cc-2203-4278-bd53-f7640e3a5466 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:42.264052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 563/1139] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:42.270364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e967ec-7312-447f-90be-61b2144728ad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:42.271130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e967ec-7312-447f-90be-61b2144728ad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:42.271285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e967ec-7312-447f-90be-61b2144728ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:42.294413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-55e967ec-7312-447f-90be-61b2144728ad None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:42.295580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-55e967ec-7312-447f-90be-61b2144728ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:42.297529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:42.368150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 577/1140] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:42.391891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f9cc-2203-4278-bd53-f7640e3a5466 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:42.442069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:42.511202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b8f9cc-2203-4278-bd53-f7640e3a5466 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:42.546142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:42.546932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:42.547203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:42.547467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:42.558213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:42.565760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:42.566895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:42.567936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 564/1141] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:42.573275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e967ec-7312-447f-90be-61b2144728ad None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:42.674489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e967ec-7312-447f-90be-61b2144728ad None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:42.720260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:42.720927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:42.721209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:42.721488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:42.722244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:42.722542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:42.723982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:42.729111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:42.732739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 578/1142] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:52:42.738928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:42.846305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:42.849509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4ac0a-31c0-4bb8-bf07-802e9a741452 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:42.885037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:42.885902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:42.886180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:42.886434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] PATH_INFO: `/v3/users/71b3bed39d1b443cb0a56949750105e7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:42.899892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] RBAC: Authorizing `identity:get_user(user_id=71b3bed39d1b443cb0a56949750105e7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:42.901364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:42.903016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 565/1143] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:42 2022] GET /identity/v3/users/71b3bed39d1b443cb0a56949750105e7 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:42.909144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:43.019662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52552aea-0a43-4dea-8df5-f27354e7dc38 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:43.054995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:43.055653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:43.055926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:43.056222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:43.130873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:43.134042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:43.136862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:43.241192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 579/1144] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:43.250745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:43.361671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f718a5-442b-44eb-b986-24ee5b1f065a None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:43.397242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:43.398034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:43.398307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:43.398576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] PATH_INFO: `/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:43.399895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] RBAC: Authorizing `identity:get_project(project_id=f9c1cf47d8e14a8ca64ff1bdde96648c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:43.401366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020f760-1ae2-470b-ba92-e4aa60f0af4b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:43.403058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 566/1145] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:43 2022] GET /identity/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:43.409810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:43.521630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:43.525048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172121fb-ea03-4433-9374-5e007f8e0c55 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:43.560814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:43.561457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:43.561729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:43.561994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:43.562827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=f9c1cf47d8e14a8ca64ff1bdde96648c, user.id=71b3bed39d1b443cb0a56949750105e7) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:43.563150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:43.564621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e646e2-40dd-43ff-ac66-c749860b94f2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:43.570179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 580/1146] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:43 2022] GET /identity/v3/role_assignments?user.id=71b3bed39d1b443cb0a56949750105e7&scope.project.id=f9c1cf47d8e14a8ca64ff1bdde96648c&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:45.569979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772e19-a7bd-47aa-a924-d77a640d48a0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:45.570569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772e19-a7bd-47aa-a924-d77a640d48a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:45.570569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e772e19-a7bd-47aa-a924-d77a640d48a0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:45.571886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 567/1147] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 03:52:45.578253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:45.578952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:45.579110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:45.599747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:45.600963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:45.671842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 581/1148] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:45.696075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772e19-a7bd-47aa-a924-d77a640d48a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:45.727697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:45.804824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e772e19-a7bd-47aa-a924-d77a640d48a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:45.839549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:45.840299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:45.840576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:45.840840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:45.851280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:45.858880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:45.859962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:45.861152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 568/1149] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:45.867303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:45.985817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:45.993930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bcbc83-8f5a-43c1-a754-612a5922dbbc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:46.028799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:46.029459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:46.029712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:46.029988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:46.030726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:46.031023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:46.032429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:46.040795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 582/1150] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:46.050008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:46.147078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:46.166700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecd3e0-67cc-40a4-a6d2-846643beff86 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:46.206289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:46.207146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:46.207425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:46.207690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] PATH_INFO: `/v3/users/71b3bed39d1b443cb0a56949750105e7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:46.209057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] RBAC: Authorizing `identity:get_user(user_id=71b3bed39d1b443cb0a56949750105e7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:46.210484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:46.212093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 569/1151] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:46 2022] GET /identity/v3/users/71b3bed39d1b443cb0a56949750105e7 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:46.218628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:46.324840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b6bef-0287-4cc0-96be-f4b34eab440c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:46.360003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:46.360874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:46.361142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:46.361398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] PATH_INFO: `/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:46.362706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=f9c1cf47d8e14a8ca64ff1bdde96648c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:46.364213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0c7e1-31a1-438f-8c4d-e47c51e2d2e5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:46.365882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 583/1152] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:46 2022] GET /identity/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:46.371867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:46.472730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540d37-d246-4632-8062-7c0e3d0b5c3f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:46.509377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:46.510264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:46.510541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:46.510810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] PATH_INFO: `/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c/users/71b3bed39d1b443cb0a56949750105e7/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:46.512897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f9c1cf47d8e14a8ca64ff1bdde96648c, user_id=71b3bed39d1b443cb0a56949750105e7, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:46.514332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da9c6db-de4c-4229-bf78-451fa2753fa1 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:46.530261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 570/1153] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:52:46 2022] PUT /identity/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c/users/71b3bed39d1b443cb0a56949750105e7/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:52:48.494427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5340fa-51d3-4a09-9349-b74bd1e05a02 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:48.495275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5340fa-51d3-4a09-9349-b74bd1e05a02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:48.495275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5340fa-51d3-4a09-9349-b74bd1e05a02 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:48.497520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 584/1154] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:48.502865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:48.503307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:48.503398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:48.521989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:48.523151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:48.532308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:48.603450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 571/1155] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:48.627627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5340fa-51d3-4a09-9349-b74bd1e05a02 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:48.660683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:48.739654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5340fa-51d3-4a09-9349-b74bd1e05a02 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:48.774438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:48.775155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:48.775432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:48.775703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:48.786401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:52:48.793980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:48.795109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:52:48.796309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 585/1156] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:48.801872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:48.912555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fc780-ad00-493e-80de-0124eda447ed None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:48.947305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:48.947977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:48.948278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:48.948550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:48.949293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:48.949590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:48.950951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:48.959265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 572/1157] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:48.965810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:49.062199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:49.081787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e98-6a9f-4159-8cb3-bfd930555b55 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:49.116259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:49.117119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:49.117389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:49.117643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] PATH_INFO: `/v3/users/71b3bed39d1b443cb0a56949750105e7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:49.118842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] RBAC: Authorizing `identity:get_user(user_id=71b3bed39d1b443cb0a56949750105e7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:49.120300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:49.121917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 586/1158] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:52:48 2022] GET /identity/v3/users/71b3bed39d1b443cb0a56949750105e7 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:49.130719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:49.140301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:49.250112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b9a54-225f-4842-a680-d8a230d987f5 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:49.284280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:49.284927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:49.285199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:49.285463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:49.353808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:49.355172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:49.362590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:49.473684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 573/1159] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 03:52:49.479914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:49.584644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22465f64-f701-4ac6-b2bb-88b38d26af01 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:49.619682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:49.620504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:49.620779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:49.621050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] PATH_INFO: `/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:49.622238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] RBAC: Authorizing `identity:get_project(project_id=f9c1cf47d8e14a8ca64ff1bdde96648c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:49.623688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a25df-f2eb-49b6-8fdf-d5913d110d1c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:49.625421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 587/1160] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:52:49 2022] GET /identity/v3/projects/f9c1cf47d8e14a8ca64ff1bdde96648c => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:49.631879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:49.735836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2192f-8549-467e-a83a-6f7355f8e9f3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:49.743029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:49.771572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:49.772243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:49.772527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:49.772801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:49.773645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=f9c1cf47d8e14a8ca64ff1bdde96648c, user.id=71b3bed39d1b443cb0a56949750105e7) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:49.773955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:49.775385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206793e4-978e-4a32-8141-73e821aa5921 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:49.781381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 574/1161] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:52:49 2022] GET /identity/v3/role_assignments?user.id=71b3bed39d1b443cb0a56949750105e7&scope.project.id=f9c1cf47d8e14a8ca64ff1bdde96648c&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:51.787175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df61-3eb9-4bad-8576-9f3347163e27 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:51.787744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df61-3eb9-4bad-8576-9f3347163e27 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:51.787744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9df61-3eb9-4bad-8576-9f3347163e27 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:51.789876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 588/1162] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:51.798690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:51.799078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:51.799300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:51.822794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:51.823969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:51.894966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 575/1163] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:51.923453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9df61-3eb9-4bad-8576-9f3347163e27 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:51.949009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:52.032874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9df61-3eb9-4bad-8576-9f3347163e27 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:52.068106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:52.068834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:52.069083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:52.069378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:52.140409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:52.141865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:52.163363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:52.246649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 589/1164] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:52:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:52:52.253615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:52.364557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:52.367486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784a45fc-d0be-4b56-9d1d-0ecd898833ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:52.403554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:52.404377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:52.404649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:52.404920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:52.412025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:52.413509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-36033928-e7e8-4a72-81a2-2ee233c0725b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:52:52.427915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:52:52.429194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:52:52.430463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 576/1165] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:52:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:52:52.438009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:52.543725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a3630-1dc9-4a75-90ac-856ef0df61e2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:52.563322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:52.579627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:52.580302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:52.580577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:52.580838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:52.581551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:52:52.581847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:52.583236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2db00-38e9-4cef-9fb2-77897ed0343e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:52.590773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 590/1166] 10.222.0.26 () {56 vars in 1115 bytes} [Thu Jul 7 03:52:52 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:54.576547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3fda-c07e-40a0-b4ff-f592b5668d6e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:54.577389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3fda-c07e-40a0-b4ff-f592b5668d6e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:54.577389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb3fda-c07e-40a0-b4ff-f592b5668d6e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:54.579576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 577/1167] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:54.587655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8d7e-4c1a-4d94-97fb-109d42aac023 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:54.588088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8d7e-4c1a-4d94-97fb-109d42aac023 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:54.588248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c8d7e-4c1a-4d94-97fb-109d42aac023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:54.615030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-175c8d7e-4c1a-4d94-97fb-109d42aac023 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:54.616233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-175c8d7e-4c1a-4d94-97fb-109d42aac023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:54.686820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 591/1168] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:54.709731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb3fda-c07e-40a0-b4ff-f592b5668d6e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:54.818208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb3fda-c07e-40a0-b4ff-f592b5668d6e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:54.854292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:54.854880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:54.855155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:54.855426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:54.856183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:54.857558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13da6-2b18-414a-aa7a-3a63bf5c6679 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:54.882939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 578/1169] 10.222.0.26 () {60 vars in 1138 bytes} [Thu Jul 7 03:52:54 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:56.930523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e8fe-b680-45fa-9cf1-fcb0e2bf870b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:56.931065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e8fe-b680-45fa-9cf1-fcb0e2bf870b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:56.931065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e8fe-b680-45fa-9cf1-fcb0e2bf870b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:56.932669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 592/1170] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:56.938282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:56.938725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:56.938815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:56.957471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:56.958646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:56.974617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:57.031975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 579/1171] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:57.056308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e8fe-b680-45fa-9cf1-fcb0e2bf870b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:57.166710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e8fe-b680-45fa-9cf1-fcb0e2bf870b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:57.182151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:57.207280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:57.208163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:57.208435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:57.208701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] PATH_INFO: `/v3/domains/4aa4fffc1269433cbb7484806c391a7a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:57.220545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4aa4fffc1269433cbb7484806c391a7a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:57.222199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82835bd-9480-47fe-baa3-ad5bf98a7e14 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:57.224076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 593/1172] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jul 7 03:52:57 2022] GET /identity/v3/domains/4aa4fffc1269433cbb7484806c391a7a => generated 267 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:57.230851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:57.353140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6174c-bac0-4206-80d8-1848d05c7149 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:57.388502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:57.389185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:57.389464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:57.389788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:57.390510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:57.391945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8868b60b-1e77-4ea6-8c24-98c5e0307cba None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:57.425313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 580/1173] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:52:57 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:52:59.433068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5111d-2fb3-4d2f-b329-c48dfd06022e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:59.433620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5111d-2fb3-4d2f-b329-c48dfd06022e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:59.433620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5111d-2fb3-4d2f-b329-c48dfd06022e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:59.435004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 594/1174] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:52:59.441349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:59.442231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:59.442325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:59.450888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:59.466291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:52:59.467445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:52:59.549098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 581/1175] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:52:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:52:59.574519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5111d-2fb3-4d2f-b329-c48dfd06022e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:59.704948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5111d-2fb3-4d2f-b329-c48dfd06022e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:59.743245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:59.744107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:59.744422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:59.744695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] PATH_INFO: `/v3/domains/4aa4fffc1269433cbb7484806c391a7a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:59.746017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4aa4fffc1269433cbb7484806c391a7a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:59.747465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2297d8-8f67-4abe-940c-e2a5cc205571 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:59.749128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 595/1176] 10.222.0.26 () {56 vars in 1183 bytes} [Thu Jul 7 03:52:59 2022] GET /identity/v3/domains/4aa4fffc1269433cbb7484806c391a7a => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:52:59.758442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:52:59.864262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f491f272-79e0-416a-9271-0fe9fd19e848 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:52:59.893654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:52:59.902579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:52:59.903633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:52:59.904088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:52:59.904596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:52:59.905752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:52:59.908051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5c4ad-ca42-45e3-8e2c-45b742f9b99e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:52:59.935963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 582/1177] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:52:59 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:53:01.976109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac49d01-bb6e-4bf0-9085-2c566c2448cf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:01.976655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac49d01-bb6e-4bf0-9085-2c566c2448cf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:01.976776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac49d01-bb6e-4bf0-9085-2c566c2448cf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:01.978150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 596/1178] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:53:01.983682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:01.984178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:01.984278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:02.001996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:53:02.003155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:53:02.079767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 583/1179] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:53:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 07 03:53:02.103741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac49d01-bb6e-4bf0-9085-2c566c2448cf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:02.153321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:02.223878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac49d01-bb6e-4bf0-9085-2c566c2448cf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:02.259645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:02.260460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:02.260738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:02.261009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:02.271828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:53:02.279471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:53:02.280621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:53:02.281611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 597/1180] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:53:02.287788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:02.400099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e1453-95b3-4907-9429-06492730e6c5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:02.417404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:02.438150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:02.438815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:02.439087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:02.439352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:02.440105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:53:02.440446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:02.441886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:02.449930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 584/1181] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:02.456112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:02.559438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad954c-5ca8-4004-a6a2-3140f4795fdb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:02.561022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:02.596731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:02.597603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:02.597963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:02.598232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] PATH_INFO: `/v3/users/32d95d2b3a7e43d3bcb231dcb5118615` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:02.611723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] RBAC: Authorizing `identity:get_user(user_id=32d95d2b3a7e43d3bcb231dcb5118615)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:02.613205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:02.614892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 598/1182] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:53:02 2022] GET /identity/v3/users/32d95d2b3a7e43d3bcb231dcb5118615 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:02.623359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:02.730500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab0337-99e0-47b7-904b-559ebe96588c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:02.765281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:02.765916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:02.766189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:02.766453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:02.815023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:02.835537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:02.837347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:02.934300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 585/1183] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:53:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:53:02.943842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:03.053436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8290cc-93c8-4336-9e12-80db6d343039 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:03.089056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:03.089847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:03.090144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:03.090427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] PATH_INFO: `/v3/projects/3adfae78e5da468e8845c51b4459bcf8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:03.091809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] RBAC: Authorizing `identity:get_project(project_id=3adfae78e5da468e8845c51b4459bcf8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:03.093330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bba0f-94c3-4154-9bc2-d2c4141e2c8e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:03.095130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 599/1184] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:53:02 2022] GET /identity/v3/projects/3adfae78e5da468e8845c51b4459bcf8 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:03.101706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:03.189834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:03.209796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26888-8185-45e8-ba73-fd98376813b4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:03.245727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:03.246371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:03.246652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:03.246922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:03.247759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=3adfae78e5da468e8845c51b4459bcf8, user.id=32d95d2b3a7e43d3bcb231dcb5118615) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:53:03.248071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:03.249525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a654944-4337-42db-ba89-ff1fc9e50069 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:03.255117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 586/1185] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:53:03 2022] GET /identity/v3/role_assignments?user.id=32d95d2b3a7e43d3bcb231dcb5118615&scope.project.id=3adfae78e5da468e8845c51b4459bcf8&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:05.232432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00799-78cb-4de5-b8aa-047fd047c54f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:05.232950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00799-78cb-4de5-b8aa-047fd047c54f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:05.232950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c00799-78cb-4de5-b8aa-047fd047c54f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:05.234284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 600/1186] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:53:05.240677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:05.241395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:05.241552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:05.263569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:53:05.264813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:53:05.337850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 587/1187] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:53:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:53:05.363905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00799-78cb-4de5-b8aa-047fd047c54f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:05.393287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:05.483936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c00799-78cb-4de5-b8aa-047fd047c54f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:05.522818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:05.523616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:05.523891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:05.524153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:05.534928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:53:05.542584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:53:05.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:53:05.544529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 601/1188] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:53:05.550792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:05.629567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:05.657042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09959cd-0eec-4d19-ae3c-f4dca8d12bdc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:05.694171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:05.694892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:05.695176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:05.695453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:05.696238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:53:05.696548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:05.697920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:05.706115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 588/1189] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:05.712943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:05.812018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:05.825718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71103749-2f39-4e49-ac31-b21bbb73cb8c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:05.860546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:05.861419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:05.861697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:05.861965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] PATH_INFO: `/v3/users/32d95d2b3a7e43d3bcb231dcb5118615` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:05.863284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=32d95d2b3a7e43d3bcb231dcb5118615)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:05.864754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:05.866378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 602/1190] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:53:05 2022] GET /identity/v3/users/32d95d2b3a7e43d3bcb231dcb5118615 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:05.872851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:05.978948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe343910-4ea5-4333-afcc-4af9304cc304 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:06.013676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:06.014534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:06.014790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:06.015071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] PATH_INFO: `/v3/projects/3adfae78e5da468e8845c51b4459bcf8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:06.016317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] RBAC: Authorizing `identity:get_project(project_id=3adfae78e5da468e8845c51b4459bcf8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:06.017747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ed218-e62b-4d7b-8b11-9321bf95c545 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:06.019464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 589/1191] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:53:05 2022] GET /identity/v3/projects/3adfae78e5da468e8845c51b4459bcf8 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:06.025633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:06.128331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a96017a-7175-424e-911b-db1f43ca9ee8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:06.167903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:06.168810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:06.169097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:06.169382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] PATH_INFO: `/v3/projects/3adfae78e5da468e8845c51b4459bcf8/users/32d95d2b3a7e43d3bcb231dcb5118615/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:06.171606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] RBAC: Authorizing `identity:create_grant(project_id=3adfae78e5da468e8845c51b4459bcf8, user_id=32d95d2b3a7e43d3bcb231dcb5118615, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:06.173063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05598ef3-6dca-4974-8011-25889a0ab646 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:06.189745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 603/1192] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:53:06 2022] PUT /identity/v3/projects/3adfae78e5da468e8845c51b4459bcf8/users/32d95d2b3a7e43d3bcb231dcb5118615/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:53:08.143545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8fdc-37fb-43db-b41a-5b17819126d9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.144507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8fdc-37fb-43db-b41a-5b17819126d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.144653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8fdc-37fb-43db-b41a-5b17819126d9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:08.146875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 590/1193] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:53:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:53:08.154139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.154797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.154954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:08.180026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:53:08.181259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:53:08.192639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:08.252936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 604/1194] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:53:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:53:08.275860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8fdc-37fb-43db-b41a-5b17819126d9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:08.279927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:08.386814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8fdc-37fb-43db-b41a-5b17819126d9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:08.426298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:08.427083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.427360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.427628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:08.438669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:53:08.446303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:53:08.447271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:53:08.448410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 591/1195] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:53:08.453633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:08.559988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5c1fd-a956-488b-88a1-46ee612084d2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:08.594979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:08.595639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.595908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.596179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:08.596936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:53:08.597233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:08.598659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:08.606703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 605/1196] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:08.613202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:08.691609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:08.735182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c21d0c-e3b0-4292-8d14-7ed583340357 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:08.768592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:08.769487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.769756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.770020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] PATH_INFO: `/v3/users/32d95d2b3a7e43d3bcb231dcb5118615` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:08.771235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] RBAC: Authorizing `identity:get_user(user_id=32d95d2b3a7e43d3bcb231dcb5118615)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:08.772703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:08.774323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 592/1197] 10.222.0.26 () {56 vars in 1177 bytes} [Thu Jul 7 03:53:08 2022] GET /identity/v3/users/32d95d2b3a7e43d3bcb231dcb5118615 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:08.780431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:08.792790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:08.899581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127f19-2c7e-411d-84af-fa0d3d43d516 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:08.933260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e459d-7dff-4514-af39-57114e117194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:08.934274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e459d-7dff-4514-af39-57114e117194 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:08.934556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e459d-7dff-4514-af39-57114e117194 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:08.934831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e459d-7dff-4514-af39-57114e117194 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:09.016780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e459d-7dff-4514-af39-57114e117194 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:09.018168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e459d-7dff-4514-af39-57114e117194 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:09.028769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:09.120881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 606/1198] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:53:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:53:09.127518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:09.237844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7624b99-6d9a-4c63-a7bd-d75e3603ee88 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:09.270237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:09.276504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:09.277359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:09.277635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:09.277894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] PATH_INFO: `/v3/projects/3adfae78e5da468e8845c51b4459bcf8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:09.279133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] RBAC: Authorizing `identity:get_project(project_id=3adfae78e5da468e8845c51b4459bcf8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:09.280597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aad95a-430a-40f1-9d8e-b4d8c5fe83bf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:09.282293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 593/1199] 10.222.0.26 () {56 vars in 1186 bytes} [Thu Jul 7 03:53:09 2022] GET /identity/v3/projects/3adfae78e5da468e8845c51b4459bcf8 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:09.288682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e459d-7dff-4514-af39-57114e117194 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:53:09.393922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e459d-7dff-4514-af39-57114e117194 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:53:09.403052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:53:09.429326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:53:09.429973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:53:09.430248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:53:09.430516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:53:09.431350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=3adfae78e5da468e8845c51b4459bcf8, user.id=32d95d2b3a7e43d3bcb231dcb5118615) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:53:09.431653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:53:09.433126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5deac75-71aa-4138-8e57-d86b0eccb9ff None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:53:09.439061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 607/1200] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:53:09 2022] GET /identity/v3/role_assignments?user.id=32d95d2b3a7e43d3bcb231dcb5118615&scope.project.id=3adfae78e5da468e8845c51b4459bcf8&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:53:19.436382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=14 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:04.523380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90838-84ed-4ab1-b2eb-e0247ce272e1 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:04.524067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90838-84ed-4ab1-b2eb-e0247ce272e1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:04.524067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d90838-84ed-4ab1-b2eb-e0247ce272e1 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:04.525327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 594/1201] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:04.530840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:04.531319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:04.531412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:04.548930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:04.550105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:04.625676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 608/1202] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:04.650428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90838-84ed-4ab1-b2eb-e0247ce272e1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:04.775387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d90838-84ed-4ab1-b2eb-e0247ce272e1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:04.816356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:04.817207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:04.817506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:04.817853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:04.829608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:04.831190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:04.855164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:04.856592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:04.857548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:04.857548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:04.857548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:04.857548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:04.857548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 595/1203] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:04.864218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:04.988754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5b959-cb7f-4fb5-b1bb-a2aed7f6ab46 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:05.020355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:05.027456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:05.028076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:05.028384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:05.028654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:05.029412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:05.029712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:05.031106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a652-aa28-4dc3-81f9-5fb837a525eb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:05.048876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 609/1204] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:05.051028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:05.112224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:05.176501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aafd69-974b-44b1-9290-c90b80bda582 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:05.220109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:05.220834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:05.221175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:05.221446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:05.222288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:05.224021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d06820-65c6-4997-a11a-f596ca18e964 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:05.256161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 596/1205] 10.222.0.26 () {60 vars in 1132 bytes} [Thu Jul 7 03:54:05 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:54:07.455126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2b83-4d15-41fd-926a-e51b0a479aba None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:07.455743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2b83-4d15-41fd-926a-e51b0a479aba None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:07.455743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc2b83-4d15-41fd-926a-e51b0a479aba None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:07.457344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 610/1206] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:07.463454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:07.464151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:07.464283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:07.485558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:07.486774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:07.564378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 597/1207] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:07.590547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc2b83-4d15-41fd-926a-e51b0a479aba None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:07.716019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc2b83-4d15-41fd-926a-e51b0a479aba None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:07.760304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:07.761268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:07.761529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:07.761799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:07.777543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:07.786390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:07.787338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:07.793479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 611/1208] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:54:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:07.794194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:07.845593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:07.915034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f008cb-6040-4c03-8430-0deeddb54fa5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:07.953141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:07.953837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:07.954193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:07.954520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:07.955245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:07.955551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:07.956996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:07.967309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 598/1209] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:54:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:07.973666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:08.037108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:08.093793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8d775-810d-4a29-8951-a84c77b8f52e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:08.131775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:08.132681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:08.132939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:08.133206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:08.145897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:08.147990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:08.170288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:08.171511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:08.172460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:08.172460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:08.172460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:08.172460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:08.172460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 612/1210] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:08.178066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:08.288606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:08.292766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594066a-795a-4033-a5c1-55267d8ccba4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:08.330260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:08.331010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:08.331294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:08.331566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:08.332505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:08.332820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:08.334287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:08.347737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 599/1211] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:08.354188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:08.479090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c3e5e-8e04-409d-aa51-ab63057c020f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:08.480907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:08.519732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:08.520652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:08.520976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:08.521255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:08.529857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:08.531375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:08.552997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:08.554004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:08.554953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 613/1212] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:54:08.560580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:08.681358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2af8-cc26-4c9b-989a-24d235e59c5b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:08.720605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:08.721293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:08.721592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:08.721822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:08.722719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:08.723021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:08.724499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:08.747190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 600/1213] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:08.748595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:08.872657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c8ec0-e3ea-4305-b268-3ce51454ee51 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:08.914023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:08.914682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:08.914961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:08.915231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:08.947047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:08.991959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:08.993810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:09.136088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 614/1214] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:54:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 07 03:54:09.142481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:09.183660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:09.282368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327a391-3137-416a-acd6-9c451d130a9c None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:09.321971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:09.322826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:09.323141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:09.323368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:09.334142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:09.335959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:09.353726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:09.356968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:09.358080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:09.358080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:09.358080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:09.358080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:09.358080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 601/1215] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:09.360982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:09.431938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:09.482136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef0171-4b09-4f77-9384-bad888b14728 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:09.520901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:09.521770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:09.522214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:09.522583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:09.524766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:09.524766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:09.525360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:09.542357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 615/1216] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:09.543779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:09.632853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:09.673978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aec017f-25fe-432f-bbef-5fd8a635b503 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:09.718111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:09.718860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:09.719141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:09.719436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:09.726667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:09.728147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:09.743087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:09.744981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:09.745889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 602/1217] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:54:09.752358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:09.866681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ffddf-7721-4adf-b48f-5376de5f4535 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:09.891785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:09.904629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:09.905319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:09.905590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:09.905856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:09.906652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:09.907011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:09.908482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b479e1b-42de-4743-904b-de76b5a37c58 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:09.927338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 616/1218] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:09.928984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:10.041800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83660f-2415-4e6a-8a90-93739fa4ab18 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:10.073438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:10.083278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:10.084280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:10.085047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:10.085482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:10.086767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=fc67945c16854249b102555f7864d148) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:10.087273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:10.088802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26600f60-00ce-4b3a-a820-822576d11f9e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:10.096680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 603/1219] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:54:09 2022] GET /identity/v3/role_assignments?user.id=fc67945c16854249b102555f7864d148&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:12.179405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984378-21c6-4020-8bc5-bb12aabccbac None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:12.180017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984378-21c6-4020-8bc5-bb12aabccbac None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:12.180017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24984378-21c6-4020-8bc5-bb12aabccbac None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:12.181583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 617/1220] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:12.187207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:12.187642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:12.187747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:12.205839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:12.207150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:12.284048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 604/1221] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:12.306406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984378-21c6-4020-8bc5-bb12aabccbac None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:12.422565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24984378-21c6-4020-8bc5-bb12aabccbac None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:12.463424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:12.464266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:12.464540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:12.464802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:12.477655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:12.485625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:12.486638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:12.487464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:12.488446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 618/1222] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:54:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:12.495275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:12.619195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7821197-7fa3-44ac-8b2a-a48e9336e7e7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:12.645547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:12.657217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:12.657905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:12.658183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:12.658496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:12.659325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:12.659683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:12.661284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:12.671460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 605/1223] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:54:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:12.678340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:12.730551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:12.799932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c636b8-dae3-40c1-a6b7-bee02ee4fc28 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:12.840032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:12.840872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:12.841213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:12.841411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:12.852575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:12.854056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:12.870576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:12.871630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:12.873051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:12.873051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:12.873051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:12.873051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:12.873051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 619/1224] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:12.878966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:12.993180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eea6b8-12c7-4281-9cc3-28717a5bbf3f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.033413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.034086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.034359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.034628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.035362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:13.035665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.037066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.049162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 606/1225] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:13.055106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:13.157892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:13.165657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c7c5a1-e66e-4aea-a6ea-27a3f8aa73d8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.203027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.203884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.204183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.204500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.213712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.215235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:13.229460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:13.230590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:13.231660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 620/1226] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:13.236863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:13.285815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:13.344275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4013c844-fd13-4183-adb3-8ffa8d971c66 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.379747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.380542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.381071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.381332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.382327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:13.382648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.384385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.405356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 607/1227] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:13.411375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:13.517146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a146fa56-d59f-4f4e-8451-9950808abec0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.551511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.552249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.552542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.552801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.563874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.565373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:13.588075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:13.589208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:13.595038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:13.595038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:13.595038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:13.595038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:13.595038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 621/1228] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:13.595371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:13.704015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e37c30-62b8-4acb-bc33-d9a69f4fae33 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.708174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:13.745629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.746310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.746583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.746915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.747645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:13.747959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.749459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.762865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 608/1229] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:13.769916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:13.780308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:13.880071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f81da7-0cbb-493b-8a95-6bd6abdf89dd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:13.914325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:13.915190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:13.915394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:13.915658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:13.922478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:13.924022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:13.942109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:13.943403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:13.944618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 622/1230] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:13.949804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:14.055134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f808e-d287-4bad-90dd-2085aca329be None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:14.096727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56311c59-3449-41d5-8833-0191e047281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:14.097400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c59-3449-41d5-8833-0191e047281e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:14.097677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c59-3449-41d5-8833-0191e047281e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:14.097946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56311c59-3449-41d5-8833-0191e047281e None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:14.098742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311c59-3449-41d5-8833-0191e047281e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:14.099046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311c59-3449-41d5-8833-0191e047281e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:14.100606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56311c59-3449-41d5-8833-0191e047281e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:14.115676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 609/1231] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:14.122095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:14.189765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:14.225794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a41bfe5-ea6a-452c-a674-faf27c7efb8a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:14.263938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:14.265098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:14.265401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:14.265726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/fc67945c16854249b102555f7864d148/roles/73893cd17bde42119631b4e5a4ad25ab` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:14.282208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=fc67945c16854249b102555f7864d148, role_id=73893cd17bde42119631b4e5a4ad25ab)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:14.283674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1877e8f1-24d5-4452-b504-be58d01cda1c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:14.298087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 623/1232] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:54:14 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/fc67945c16854249b102555f7864d148/roles/73893cd17bde42119631b4e5a4ad25ab => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:54:16.347251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272d8-2da2-4577-a30c-8b126db1aff6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:16.347840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272d8-2da2-4577-a30c-8b126db1aff6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:16.347840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937272d8-2da2-4577-a30c-8b126db1aff6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:16.349315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 610/1233] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:16.355595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:16.356039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:16.356245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:16.375900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:16.378134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:16.459464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 624/1234] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:16.484308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937272d8-2da2-4577-a30c-8b126db1aff6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:16.514674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:16.602057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937272d8-2da2-4577-a30c-8b126db1aff6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:16.637622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:16.638438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:16.638717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:16.638977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:16.649758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:16.657475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:16.658695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:16.659696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 611/1235] 10.222.0.26 () {56 vars in 1102 bytes} [Thu Jul 7 03:54:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:16.665434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:16.719713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:16.777140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9265a0-4f4f-41f8-a117-b22680a5b352 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:16.815482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:16.816350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:16.816613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:16.816959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:16.817894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:16.818322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:16.819790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:16.828405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 625/1236] 10.222.0.26 () {56 vars in 1103 bytes} [Thu Jul 7 03:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:16.834431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:16.933296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:16.951744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93651fe-2b1c-4b60-a5b8-9c4da1e54a86 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:16.997458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:16.998283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:16.998554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:16.998817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:17.010228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:17.011692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:17.028645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:17.029767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:17.030828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:17.030828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:17.030828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:17.030828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:17.030828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 612/1237] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:17.036889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:17.145983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518ac8-0618-43f5-acf0-4b10044d438b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:17.155351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:17.184048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:17.184739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:17.185001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:17.185243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:17.185983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:17.186288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:17.187691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:17.199998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 626/1238] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:17.206358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:17.313398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51019ceb-9991-4f5b-89e8-0c9f107efafe None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:17.361764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:17.362590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:17.362864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:17.363133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:17.366212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:17.372464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:17.374204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:17.389653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:17.390748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:17.391754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 613/1239] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:17.397101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:17.505727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe37e-7aed-40d1-96d0-5821e716fa47 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:17.543379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:17.544051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:17.544351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:17.544614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:17.545450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:17.545751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:17.548346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:17.566727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 627/1240] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:17.572565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:17.690626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea629e2e-c5e7-43a8-9231-b160010044dd None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:17.739725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:17.740537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:17.740798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:17.741065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:17.810412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:17.818089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:17.819552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:17.938557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 614/1241] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:54:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:54:17.941070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:17.972336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:18.056931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c77b9a-90a2-418c-950d-016d4c025842 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:18.094616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:18.095487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:18.095829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:18.096103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:18.106328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:18.107855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:18.128045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:18.129224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:18.135405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:18.135405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:18.135405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:18.135405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:18.135405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 628/1242] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:18.135801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:18.248444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:18.255461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d0589-4ff7-4f81-b243-eb92cba17c06 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:18.294397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:18.295198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:18.295491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:18.295813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:18.296612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:18.296916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:18.298673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:18.312807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 615/1243] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:18.319489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:18.424334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:18.455145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b0629f-3c32-4ae8-8c9c-9a9c3427bb27 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:18.496728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:18.497717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:18.497980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:18.498325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:18.506091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:18.507638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:18.521359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:18.522370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:18.523463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 629/1244] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:18.530160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:18.643991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3368b-1e81-4583-b461-55c4d16ebfa8 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:18.689090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:18.689885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:18.690384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:18.690716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:18.691763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:18.692212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:18.693967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d5aa4d-21fb-43b2-b5da-a0df15ba362e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:18.710241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 616/1245] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:18.717621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:18.835623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bf7d6-7f7b-4297-b498-a837347dfd0e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:18.873100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:18.873823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:18.874243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:18.874600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:18.875733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] RBAC: Adding query filter params (role.id=73893cd17bde42119631b4e5a4ad25ab, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=fc67945c16854249b102555f7864d148) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:18.876059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:18.877778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee24015-4c26-46be-9c30-44b0e8719585 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:18.884696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 630/1246] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:54:18 2022] GET /identity/v3/role_assignments?user.id=fc67945c16854249b102555f7864d148&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=73893cd17bde42119631b4e5a4ad25ab => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:21.401300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6daf2-33c2-472b-a2b9-3c5f67106df9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:21.401913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6daf2-33c2-472b-a2b9-3c5f67106df9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:21.401913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6daf2-33c2-472b-a2b9-3c5f67106df9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:21.403505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 617/1247] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:21.410392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:21.410945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:21.410945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:21.416955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:21.430317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:21.431483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:21.507159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 631/1248] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:21.538027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6daf2-33c2-472b-a2b9-3c5f67106df9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:21.557352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:21.651726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6daf2-33c2-472b-a2b9-3c5f67106df9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:21.694438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:21.695440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:21.695742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:21.696085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:21.711917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:21.720416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:21.721737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:21.722725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 618/1249] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:54:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:21.730399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:21.850193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f2ddb-307f-4652-8cc9-9f559bf43187 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:21.890066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:21.895730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:21.896462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:21.896744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:21.897019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:21.897895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:21.898250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:21.899881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:21.910915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 632/1250] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:54:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:21.916875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:22.011619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:22.040214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49f23d7-30ba-4a1b-a600-83cd627d072d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:22.081665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:22.082593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:22.082872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:22.083145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:22.097483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:22.098959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:22.119045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:22.120217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:22.121360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:22.121360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:22.121360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:22.121360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:22.121360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 619/1251] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:22.126814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:22.245872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e72936-d74a-4af5-82de-54f6c4a6838f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:22.290544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:22.291242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:22.291519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:22.291958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:22.293254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:22.293746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:22.295718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:22.312979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 633/1252] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:22.320679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:22.440558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183520f-4cad-4660-a1ca-ed8ac3030b75 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:22.469357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:22.478900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:22.479763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:22.480038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:22.480377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:22.491623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:22.493161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:22.509472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:22.511088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:22.512617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 620/1253] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:22.517913 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:22.594647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:22.648260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68335836-ff0f-43fc-a2ba-2bb702105485 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:22.696455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:22.697543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:22.697902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:22.698219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:22.699431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:22.699834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:22.702188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:22.726656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 634/1254] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:22.733366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:22.864954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaed7e-ed21-48d8-a722-465bf88d20cf None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:22.905357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:22.906024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:22.906347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:22.906599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:22.979255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:22.993870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:22.995393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:23.109336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 621/1255] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:54:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:54:23.116644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:23.233317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da87c62-0759-438e-b191-ebf6bc1e2452 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:23.247306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:23.271045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:23.272300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:23.272619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:23.272892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:23.284197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:23.286301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:23.304318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:23.305464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:23.306465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:23.306465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:23.306465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:23.306465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:23.307071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 635/1256] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:23.313990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:23.408151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:23.421107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe948d-af8e-4722-81b7-f9dd3130c7e3 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:23.457513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:23.458310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:23.458623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:23.458911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:23.460053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:23.460389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:23.461981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:23.479044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 622/1257] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:23.480665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:23.595300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc40fa-ed74-4c01-9859-69cc64286cc8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:23.637009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:23.637817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:23.638097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:23.638368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:23.645755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:23.647299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:23.662783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:23.663794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:23.664737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 636/1258] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:23.670918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:23.793322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44c21b-7f7d-4142-ab43-01e2a73ba5ff None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:23.834224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:23.835259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:23.835536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:23.835836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:23.836676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:23.836986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:23.838488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be947ed8-ee40-4c2f-801c-f773ab3e6665 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:23.852578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 623/1259] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:23.858813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:23.887485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:23.971887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575ae4b-f322-4287-bfdb-1841ba2e8c1a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:24.010420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:24.011133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:24.011513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:24.011911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:24.013120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=fc67945c16854249b102555f7864d148) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:24.013509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:24.015238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1423862-8bd3-4ee2-ab92-90a78de9e1db None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:24.021794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 637/1260] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:54:23 2022] GET /identity/v3/role_assignments?user.id=fc67945c16854249b102555f7864d148&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:26.095732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bba6-aa62-4454-afad-f62605cb17b6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.096638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bba6-aa62-4454-afad-f62605cb17b6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.096638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487bba6-aa62-4454-afad-f62605cb17b6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.098924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 624/1261] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:26.105467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.105896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.106091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.125250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:26.126448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:26.197077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 638/1262] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:26.221792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487bba6-aa62-4454-afad-f62605cb17b6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:26.234595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:26.331472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487bba6-aa62-4454-afad-f62605cb17b6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:26.366559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:26.367353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.367628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.367892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.378070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:26.385548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:26.386653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:26.387755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 625/1263] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:26.393875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:26.418165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:26.509293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da5ec1-e8b5-4b81-9091-c94f6c13b77a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:26.544904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:26.545627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.545905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.546182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.546979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:26.547286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:26.548734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:26.556995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 639/1264] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:26.563851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:26.642872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:26.680892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfd7e4-0baa-4d0b-aeee-73db80f48e2d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:26.724077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:26.725585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.725899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.726160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.742111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:26.743780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:26.766192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:26.767152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:26.768220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:26.768220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:26.768220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:26.768220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:26.768220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 626/1265] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:26.773363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:26.855704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:26.877910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be2a98-eb58-4fa4-af27-03c246c9c21b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:26.913667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:26.914356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:26.914660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:26.914926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:26.915655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:26.915955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:26.917377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:26.929701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 640/1266] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:26.935527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.042412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839fde8-b66c-42f2-8a32-ae94572b2213 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.065538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:27.080140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.081002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.081279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.081544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.089754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:27.091214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:27.105584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:27.107119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:27.108486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 627/1267] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:27.113549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.218401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde934cf-2e7b-4c66-8982-70bb980ecb9b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.253155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.253822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.254101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.254366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.255219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:27.255525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:27.259489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:27.268395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:27.277416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 641/1268] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:27.283653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.386948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeddeb2-2a48-466a-95b7-2b8d36f6245b None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.423229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.424215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.424515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.424787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.435601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:27.437084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:27.454770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:27.455775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:27.456888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:27.456888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:27.456888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:27.456888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:27.456888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 628/1269] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:27.466728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.578980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2310e4d-519c-4b15-aa56-9ca874e2ddf3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.620520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.621181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.621460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.621731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.622461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:27.622760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:27.624165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:27.637635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 642/1270] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:27.643966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.691500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:27.767915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12997ef-46ee-4068-9199-e21cfedd669f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.814683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.815539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.815812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.816078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.823521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:27.825095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:27.840392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:27.841380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:27.842508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 629/1271] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:54:27.847826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:27.906514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:27.950715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd57b0b-4f49-4dbf-8b50-c6425bba3d17 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:27.995980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:27.997042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:27.997422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:27.997795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:27.999019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:27.999436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:28.001791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8789-338b-4b24-9ca4-1d925f2b892d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:28.014098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 643/1272] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:28.020595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:28.117212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:28.132178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2a55b-af58-4d13-a02f-82f9a18c5825 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:28.171359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:28.172227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:28.172507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:28.172774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] PATH_INFO: `/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/fc67945c16854249b102555f7864d148/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:28.175055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] RBAC: Authorizing `identity:create_grant(project_id=e4b336389d1e459695fa2a0453a08c93, user_id=fc67945c16854249b102555f7864d148, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:28.176521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca89f5d-ca48-4086-867a-8d7c9c0b982d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:28.192961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 630/1273] 10.222.0.26 () {58 vars in 1439 bytes} [Thu Jul 7 03:54:28 2022] PUT /identity/v3/projects/e4b336389d1e459695fa2a0453a08c93/users/fc67945c16854249b102555f7864d148/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:54:30.206719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52d5c-f32b-4596-aaa6-dd9b4a6897ca None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:30.207278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52d5c-f32b-4596-aaa6-dd9b4a6897ca None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:30.207278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e52d5c-f32b-4596-aaa6-dd9b4a6897ca None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:30.208714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 644/1274] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:30.215621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:30.216407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:30.216526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:30.236292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:30.237496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:30.306289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 631/1275] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:30.330301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e52d5c-f32b-4596-aaa6-dd9b4a6897ca None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:30.442887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e52d5c-f32b-4596-aaa6-dd9b4a6897ca None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:30.465611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:30.483464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:30.484291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:30.484569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:30.484838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:30.496000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 07 03:54:30.503692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:30.504878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:30.505792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 645/1276] 10.222.0.26 () {56 vars in 1096 bytes} [Thu Jul 7 03:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:30.510924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:30.595013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:30.615136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802df02-8d8f-4073-87bc-fd5cfc57c793 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:30.651052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:30.651757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:30.652035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:30.652335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:30.653096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:30.653399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:30.654787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:30.662868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 632/1277] 10.222.0.26 () {56 vars in 1099 bytes} [Thu Jul 7 03:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:30.669486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:30.774362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7f742-1bce-499b-aa59-bf4dc7b580d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:30.811654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:30.812486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:30.812765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:30.813003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:30.823935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:30.825494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:30.842739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:30.843753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:30.844867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:30.844867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:30.844867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:30.844867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:30.844867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 646/1278] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 07 03:54:30.850880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:30.982880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be845c-5fc5-4503-b23a-1591f7553508 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:31.018005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:31.018682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:31.018958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:31.019255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:31.019962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:31.020357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:31.021744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:31.033728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 633/1279] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:31.043211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:31.079723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:31.152764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ce15b2-e0a0-4870-9577-44fb75e70934 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:31.187749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:31.188580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:31.188857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:31.189128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:31.198247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:31.199815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 07 03:54:31.215410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:31.216932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:31.218127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 647/1280] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:31.223278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:31.227701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:31.333742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8ce2d-2bc6-414a-ba39-5dd6bd8fd541 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:31.368441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:31.369119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:31.369397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:31.369667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:31.370530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:31.370837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:31.372326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:31.389458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 634/1281] 10.222.0.26 () {56 vars in 1143 bytes} [Thu Jul 7 03:54:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:31.396656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:31.494056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:31.508542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee391c-a90d-427f-bdeb-dc300862c249 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:31.543957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:31.544686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:31.544961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:31.545228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:31.618801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:31.620282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:31.716477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:31.727990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 648/1282] 10.222.0.26 () {58 vars in 1282 bytes} [Thu Jul 7 03:54:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 07 03:54:31.734283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:31.799217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:31.837818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06234f84-158e-40f1-800e-c3d0c059c15d None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:31.874116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:31.874854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:31.875132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:31.875400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:31.885735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:31.887186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 07 03:54:31.904857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:31.905854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:31.907028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 07 03:54:31.907028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 07 03:54:31.907028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 07 03:54:31.907028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:31.907028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 635/1283] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:54:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:31.914507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:32.016814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e69c06-e17c-4b87-8c58-1d69cce996f0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:32.052389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:32.053096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:32.053375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:32.053643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:32.054397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:32.054698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:32.056171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:32.067551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 649/1284] 10.222.0.26 () {56 vars in 1109 bytes} [Thu Jul 7 03:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:32.073619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:32.187987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa9965-b35a-4ff4-bc07-0a3bd95ed64f None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:32.204136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:32.225655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:32.226499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:32.226815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:32.227091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:32.234652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:32.236176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 07 03:54:32.250692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:32.251770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: ERROR keystone.server.flask.application Jul 07 03:54:32.252828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 636/1285] 10.222.0.26 () {56 vars in 1111 bytes} [Thu Jul 7 03:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:32.260414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:32.312619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:32.366150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a240-7ea4-445c-8d26-61aed936cd00 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:32.401621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:32.402342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:32.402626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:32.402900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:32.403715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:32.404017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:32.405543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fb9b9b-4fd9-43c5-bd0b-d97c013ff833 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:32.418151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 650/1286] 10.222.0.26 () {56 vars in 1148 bytes} [Thu Jul 7 03:54:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 03:54:32.428519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:32.543768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf5ee-a1bc-454e-8940-e411a2cfc071 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:32.579217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:32.579890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:32.580189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:32.580459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:32.581393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] RBAC: Adding query filter params (role.id=934fc30b07224e74a7e92e71e67aa4e9, scope.project.id=e4b336389d1e459695fa2a0453a08c93, user.id=fc67945c16854249b102555f7864d148) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:32.581698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:32.583172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd5b27-b88e-47f8-ac4c-15486bd48d22 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:32.589874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 637/1287] 10.222.0.26 () {56 vars in 1374 bytes} [Thu Jul 7 03:54:32 2022] GET /identity/v3/role_assignments?user.id=fc67945c16854249b102555f7864d148&scope.project.id=e4b336389d1e459695fa2a0453a08c93&role.id=934fc30b07224e74a7e92e71e67aa4e9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:34.640767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631707-5847-4083-956b-60db34e816b1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:34.641694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631707-5847-4083-956b-60db34e816b1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:34.641694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58631707-5847-4083-956b-60db34e816b1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:34.643898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 651/1288] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:34.649209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:34.649657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:34.649757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:34.669981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:34.671173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:34.706072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:34.753106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 638/1289] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:34.778885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631707-5847-4083-956b-60db34e816b1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:34.906311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58631707-5847-4083-956b-60db34e816b1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:34.917363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:34.949266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:34.950444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:34.950810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:34.951161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:34.952378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:34.954507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:34.967860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:34.969138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:34.970515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 652/1290] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:54:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:34.975491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:35.081270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934206c4-79fd-4ea5-9e80-e912bacc09be None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:35.128604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:35.129300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:35.129574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:35.129839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:35.130551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:35.130850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:35.132233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7649e0ce-8c0d-478f-baa1-d8ab9ad6e881 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:35.137365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 639/1291] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jul 7 03:54:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:35.143223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:35.259571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a61cd9-adae-4458-8908-a1e4eae91935 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:35.294202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:35.294866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:35.295140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:35.295406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:35.296148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:35.296448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:35.297838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203318e9-4c0d-4fe2-83b0-7f9643588c33 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:35.302500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 653/1292] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jul 7 03:54:35 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:37.283739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04cf0-e12a-413f-8322-e428afdd7168 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:37.284329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04cf0-e12a-413f-8322-e428afdd7168 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:37.284329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e04cf0-e12a-413f-8322-e428afdd7168 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:37.285708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 640/1293] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:37.294594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6208c-9b10-4e42-8519-588c0b1b2f51 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:37.295020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6208c-9b10-4e42-8519-588c0b1b2f51 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:37.295159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6208c-9b10-4e42-8519-588c0b1b2f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:37.316172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-05b6208c-9b10-4e42-8519-588c0b1b2f51 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:37.317364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05b6208c-9b10-4e42-8519-588c0b1b2f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:37.349870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:37.387880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 654/1294] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:37.411126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04cf0-e12a-413f-8322-e428afdd7168 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:37.448890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:37.531143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e04cf0-e12a-413f-8322-e428afdd7168 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:37.573171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:37.573760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:37.574035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:37.574301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:37.575059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:37.576475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a5ff9-d2e1-46b8-a636-50a2018d6ed4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:37.592801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 641/1295] 10.222.0.26 () {60 vars in 1141 bytes} [Thu Jul 7 03:54:37 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:54:39.608690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d5f0-b48c-4dd0-ac94-8ec11806c277 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:39.609268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d5f0-b48c-4dd0-ac94-8ec11806c277 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:39.609268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d5f0-b48c-4dd0-ac94-8ec11806c277 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:39.610663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 655/1296] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:39.615913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:39.616402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:39.616553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:39.633385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:39.634566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:39.717213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 642/1297] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:39.742324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d5f0-b48c-4dd0-ac94-8ec11806c277 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:39.864682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d5f0-b48c-4dd0-ac94-8ec11806c277 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:39.905142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:39.906359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:39.906781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:39.907197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:39.908295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:39.910624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:39.924158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:39.925298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:39.926341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 656/1298] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:54:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:39.931991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:39.952093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:40.051762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f07349-5b5b-40ec-b3b6-6f2001af0729 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:40.094466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:40.095137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:40.095419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:40.095691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:40.096440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:40.096747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:40.098135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:40.103520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 643/1299] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jul 7 03:54:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:40.109676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:40.143627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:40.214848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974be9-5f7a-460c-9553-92166b7877ee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:40.256380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:40.257043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:40.257322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:40.257595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:40.258401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] RBAC: Adding query filter params (interface=public, service_id=835ad1f7e82c4473bc72bdb85a225f17, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:40.258711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:40.260102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522b82f4-37b6-4571-a46b-8ebb7f4bed13 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:40.266055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 657/1300] 10.222.0.26 () {56 vars in 1251 bytes} [Thu Jul 7 03:54:40 2022] GET /identity/v3/endpoints?service_id=835ad1f7e82c4473bc72bdb85a225f17&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:40.272093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:40.358900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:40.380850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7dc2a-db52-41dc-9742-fa73fb1aaef4 None admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:40.415486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:40.416080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:40.416384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:40.416654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:40.417338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:40.418702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c246ec2-fe0e-409a-b2f9-8567d292b31e None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:40.426153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 644/1301] 10.222.0.26 () {56 vars in 1087 bytes} [Thu Jul 7 03:54:40 2022] GET /identity/v3/services => generated 2191 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:54:42.461498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f40c11-08bd-4878-b2f4-1bb0c4e95f82 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:42.462094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f40c11-08bd-4878-b2f4-1bb0c4e95f82 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:42.462094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f40c11-08bd-4878-b2f4-1bb0c4e95f82 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:42.463444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 658/1302] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:54:42.469685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:42.470401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:42.470567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:42.496902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:54:42.498117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:54:42.573720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 645/1303] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:54:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 07 03:54:42.607245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f40c11-08bd-4878-b2f4-1bb0c4e95f82 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:42.717005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:42.724490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f40c11-08bd-4878-b2f4-1bb0c4e95f82 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:42.760142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:42.760979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:42.761254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:42.761527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:42.762203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:42.763650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 07 03:54:42.775923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 07 03:54:42.777107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 07 03:54:42.778163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 659/1304] 10.222.0.26 () {56 vars in 1117 bytes} [Thu Jul 7 03:54:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 07 03:54:42.784177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:42.860980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:42.887423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333c544-3f7e-46ce-bbf8-466d882b2e5a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:42.922705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:42.923359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:42.923633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:42.923902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] PATH_INFO: `/v3/services` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:42.924651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:54:42.924922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:42.926342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e712f8-273a-4e08-8bb8-bc5be76dda53 None admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:42.931775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 646/1305] 10.222.0.26 () {56 vars in 1116 bytes} [Thu Jul 7 03:54:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:54:42.937704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:54:43.040376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ff69-2726-42a6-96f2-32daafea8176 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:54:43.076314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:54:43.076957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:54:43.077232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:54:43.077500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:54:43.078240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:54:43.079611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c1a8b-688c-4d70-a6b1-80d3d4d41e1e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:54:43.101495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 660/1306] 10.222.0.26 () {60 vars in 1144 bytes} [Thu Jul 7 03:54:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:54:52.928948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=30 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:54:53.097314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:45.734029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aa2e-ff92-465f-b900-c938eb61fc37 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:45.735065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aa2e-ff92-465f-b900-c938eb61fc37 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:45.735563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a799aa2e-ff92-465f-b900-c938eb61fc37 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:45.741240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 647/1307] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:55:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:45.742673 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1427d-d2d5-42f5-8747-130701171027 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:45.743111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1427d-d2d5-42f5-8747-130701171027 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:45.743337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b1427d-d2d5-42f5-8747-130701171027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:45.817582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-68b1427d-d2d5-42f5-8747-130701171027 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:45.818677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-68b1427d-d2d5-42f5-8747-130701171027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:45.919407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 661/1308] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 03:55:45.967419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:45.967706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:45.967977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:45.969691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 648/1309] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jul 7 03:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:45.975627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc080-a9ca-4b8b-af71-2940d944e5ea None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:45.975916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc080-a9ca-4b8b-af71-2940d944e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:45.976253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cc080-a9ca-4b8b-af71-2940d944e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:46.068658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-527cc080-a9ca-4b8b-af71-2940d944e5ea None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:46.069885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-527cc080-a9ca-4b8b-af71-2940d944e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:46.107625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:46.192294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 662/1310] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jul 7 03:55:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:46.195876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:55:46.197723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:46.332619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbbef9-d1e7-4269-86ab-0d14458daea6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:55:46.409050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:55:46.410088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:46.410430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:46.410766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:46.412519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:46.468935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:46.526720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:55:46.528298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7248d5-1e25-4b56-b664-262465be46f1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:55:46.547736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 649/1311] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 03:55:48.828262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb596a5e-d950-42aa-91a5-3d842bbcf042 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:48.828799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb596a5e-d950-42aa-91a5-3d842bbcf042 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:48.828799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb596a5e-d950-42aa-91a5-3d842bbcf042 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:48.830260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 663/1312] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:48.835501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc727e0d-0da1-4a6d-b2b5-39853b323839 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:48.835893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc727e0d-0da1-4a6d-b2b5-39853b323839 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:48.836047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc727e0d-0da1-4a6d-b2b5-39853b323839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:48.922407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc727e0d-0da1-4a6d-b2b5-39853b323839 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:48.923620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc727e0d-0da1-4a6d-b2b5-39853b323839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:49.031076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 650/1313] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:49.083819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:49.084141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:49.084493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:49.085938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 664/1314] 10.222.0.26 () {54 vars in 964 bytes} [Thu Jul 7 03:55:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:49.092957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf23b4-93dc-471e-aced-a353470f239a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:49.093341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf23b4-93dc-471e-aced-a353470f239a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:49.093617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf23b4-93dc-471e-aced-a353470f239a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:49.104808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:49.175705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8bbf23b4-93dc-471e-aced-a353470f239a None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:49.176956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8bbf23b4-93dc-471e-aced-a353470f239a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:49.252257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 651/1315] 10.222.0.26 () {58 vars in 1061 bytes} [Thu Jul 7 03:55:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:49.261434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:55:49.262961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:49.373246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb4153-ffcb-46e5-acea-5d27474d6f0a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:55:49.444572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:49.447022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:55:49.447690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:49.447999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:49.448595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:49.450691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:49.568474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:55:49.569943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9104f762-a968-474d-a56d-3afc61989797 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:55:49.590071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 665/1316] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:55:52.131250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:52.131754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:52.131754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:52.133246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 652/1317] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:52.138999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6038-69c4-44af-9d37-43a0b02f97f6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:52.139440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6038-69c4-44af-9d37-43a0b02f97f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:52.139539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db6038-69c4-44af-9d37-43a0b02f97f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:52.206501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-37db6038-69c4-44af-9d37-43a0b02f97f6 None None] MFA Rules not processed for user `19194edf08ae47abb66f1bcede072b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:52.207730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37db6038-69c4-44af-9d37-43a0b02f97f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:52.267610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:52.317669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 666/1318] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:55:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:52.362819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:55:52.364421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:52.480048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b8b4c-1d17-4f00-a8c0-f557aec84516 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:55:52.482999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:52.560132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:55:52.560803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:52.561085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:52.561355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:52.563011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:52.674861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:55:52.676333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4509f2-9155-40e5-982b-81164ad8d0b2 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:55:52.695003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 653/1319] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:55:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:55:55.255668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:55.256284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:55.256284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:55.257569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 667/1320] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:55.263109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f831b8-6bfd-4b1e-ad07-ee5e7b1522f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:55.263529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f831b8-6bfd-4b1e-ad07-ee5e7b1522f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:55.263618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f831b8-6bfd-4b1e-ad07-ee5e7b1522f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:55.303876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:55.329751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-51f831b8-6bfd-4b1e-ad07-ee5e7b1522f3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:55.330983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-51f831b8-6bfd-4b1e-ad07-ee5e7b1522f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:55.438506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 654/1321] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:55:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:55.476635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:55:55.478283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:55.585538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c6658-7ebd-4289-9ae0-747ddb1e8542 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:55:55.661240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:55:55.661891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:55.662172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:55.662448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:55.664096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:55.671765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:55.775285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:55:55.776765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102708b-e9bb-4672-82a7-2e02854b7e5b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:55:55.795268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 668/1322] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:55:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:55:58.472350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:58.472932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:58.472932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:58.474301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 655/1323] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:55:58.479667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f66a8-bdbf-456f-98a8-39f5f30ce3ad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:58.480101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f66a8-bdbf-456f-98a8-39f5f30ce3ad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:58.480275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f66a8-bdbf-456f-98a8-39f5f30ce3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:58.551495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a64f66a8-bdbf-456f-98a8-39f5f30ce3ad None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:55:58.552736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a64f66a8-bdbf-456f-98a8-39f5f30ce3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:58.613777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:58.659422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 669/1324] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:55:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:55:58.696545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:55:58.698174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:58.813424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000206-ca91-4d2b-985b-a3432622e654 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:55:58.826451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:55:58.890427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:55:58.891080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:55:58.891356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:55:58.891621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:55:58.893299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:55:59.009815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:55:59.011250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0decc9ad-1de5-4124-bfd4-c874c7c4b39c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:55:59.029520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 656/1325] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:55:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:01.089580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:01.090098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:01.090098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:01.091424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 670/1326] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:01.096750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e667-7150-4fd4-b81a-cec9e2a4aa7a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:01.097189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e667-7150-4fd4-b81a-cec9e2a4aa7a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:01.097276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2e667-7150-4fd4-b81a-cec9e2a4aa7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:01.145761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:01.164863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b7c2e667-7150-4fd4-b81a-cec9e2a4aa7a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:01.166094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b7c2e667-7150-4fd4-b81a-cec9e2a4aa7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:01.265758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 657/1327] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:01.301489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:01.303112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:01.410183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a328132-56b5-4af5-8824-5d4e8f4b929d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:01.493849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:01.494494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:01.494772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:01.495041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:01.496780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:01.514482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:01.610458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:01.611926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b0b84f-141b-4ac3-87cf-ddf7aa4253c6 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:01.631704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 671/1328] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:03.668563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:03.669117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:03.669117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:03.670559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 658/1329] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:03.675876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed589-78e8-471b-beb4-5da8e43a7a26 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:03.676339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed589-78e8-471b-beb4-5da8e43a7a26 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:03.676433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ed589-78e8-471b-beb4-5da8e43a7a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:03.746033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e6ed589-78e8-471b-beb4-5da8e43a7a26 None None] MFA Rules not processed for user `19194edf08ae47abb66f1bcede072b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:03.747277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e6ed589-78e8-471b-beb4-5da8e43a7a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:03.814807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:03.849217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 672/1330] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:03 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:03.887038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:03.888614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:03.997647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d12157-2e40-4eb9-90ab-96214c9fea09 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:04.018771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:04.077650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:04.078338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:04.078615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:04.078883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:04.080613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:04.192608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:04.194062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381b58-eac0-4c29-926e-64a98498d169 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:04.225955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 659/1331] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 03:56:06.499970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:06.500609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:06.500609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:06.501873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 673/1332] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:06.507304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbc02-d1a3-413e-8a6c-5f46ac8093b1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:06.507752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbc02-d1a3-413e-8a6c-5f46ac8093b1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:06.507867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00bbc02-d1a3-413e-8a6c-5f46ac8093b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:06.573756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:06.576896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c00bbc02-d1a3-413e-8a6c-5f46ac8093b1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:06.578945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c00bbc02-d1a3-413e-8a6c-5f46ac8093b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:06.690066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 660/1333] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:06.729584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:06.731927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:06.849090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee18a-53b4-48a9-9626-446ab0911da4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:06.932563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:06.933222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:06.933498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:06.933768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:06.935451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:06.965741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:07.049766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:07.051231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8aa8f2-fe79-4f33-88ab-f84265ace59d service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:07.070827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 674/1334] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:09.117357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:09.117942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:09.117942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:09.119300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 661/1335] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:09.124748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16e9a-f858-4d9d-80d1-313a37d4be4b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:09.125186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16e9a-f858-4d9d-80d1-313a37d4be4b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:09.125276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c16e9a-f858-4d9d-80d1-313a37d4be4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:09.192559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c5c16e9a-f858-4d9d-80d1-313a37d4be4b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:09.193671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c5c16e9a-f858-4d9d-80d1-313a37d4be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:09.282982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:09.306819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 675/1336] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:09.354557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:09.356108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:09.472269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d99f3-f6ad-4b3b-871d-4825dd86cdcb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:09.501743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:09.550202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:09.550857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:09.551153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:09.551426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:09.553109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:09.669905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:09.671341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ecbc3-239c-4fdd-b9cb-82eb51e8d61e service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:09.695475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 662/1337] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:12.044363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:12.044942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:12.044942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:12.046311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 676/1338] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:12.052852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced22-a7a5-4d01-80df-91e52638b3a9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:12.053314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced22-a7a5-4d01-80df-91e52638b3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:12.053417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bced22-a7a5-4d01-80df-91e52638b3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:12.136493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-82bced22-a7a5-4d01-80df-91e52638b3a9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:12.137713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-82bced22-a7a5-4d01-80df-91e52638b3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:12.146599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:12.238713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 663/1339] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:12.274331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:12.275942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:12.387629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09fe52-eb42-4a78-8e8a-0cabce9b7479 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:12.464059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:12.464728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:12.465000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:12.465270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:12.466890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:12.503868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:12.592292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:12.593768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819c518-6fe0-4660-b265-cefcee4886ba service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:12.614907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 677/1340] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:16.571712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:16.572295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:16.572295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:16.573668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 664/1341] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:16.579634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615520b4-d2f6-48eb-891f-a939674d4adb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:16.580064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615520b4-d2f6-48eb-891f-a939674d4adb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:16.580567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615520b4-d2f6-48eb-891f-a939674d4adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:16.666012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-615520b4-d2f6-48eb-891f-a939674d4adb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:16.667130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-615520b4-d2f6-48eb-891f-a939674d4adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:16.763623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:16.777252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 678/1342] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:16.816446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:16.819387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:16.925435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32d4e5-cdfe-4413-a37b-08973d050ad8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:16.929608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:16.930424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:16.930797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:16.931007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:16.942038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:16.943493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d638e06-8fcf-4aba-9bd7-2959c2556bd1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:16.953962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 665/1343] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:19.637203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:19.637810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:19.637810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:19.639161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 679/1344] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:19.644576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e982-5036-4db7-8bf3-149891dbb182 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:19.645034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e982-5036-4db7-8bf3-149891dbb182 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:19.645133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062e982-5036-4db7-8bf3-149891dbb182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:19.675875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e062e982-5036-4db7-8bf3-149891dbb182 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:19.677175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e062e982-5036-4db7-8bf3-149891dbb182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:19.710285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:19.767011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 666/1345] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:19.806547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:19.808624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:19.824343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c6d7e-4113-4fb5-be51-d71871e57afe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:19.829395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:19.830062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:19.830325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:19.830595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:19.841905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:19.843390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5188a2-dc6a-46ea-b343-f8c3e985119c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:19.854904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 680/1346] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:24.402935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311723c-9d64-4919-80cd-7588d27e93d0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:24.403509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311723c-9d64-4919-80cd-7588d27e93d0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:24.403851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311723c-9d64-4919-80cd-7588d27e93d0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:24.406027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 667/1347] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:24.414484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076433-883d-4354-97d4-38f6abbc1f12 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:24.415270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076433-883d-4354-97d4-38f6abbc1f12 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:24.416194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75076433-883d-4354-97d4-38f6abbc1f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:24.437758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-75076433-883d-4354-97d4-38f6abbc1f12 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:24.439131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75076433-883d-4354-97d4-38f6abbc1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:24.447548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 681/1348] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:24.489192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311723c-9d64-4919-80cd-7588d27e93d0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:24.500543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311723c-9d64-4919-80cd-7588d27e93d0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:24.504072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:24.506477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:24.506477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:24.506477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:24.522176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:24.523640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c886e-1806-4673-9821-b67121b776c4 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:24.534599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 668/1349] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 03:56:29.410681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f29-7984-4fc2-af78-78b461cf80cf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:29.410681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f29-7984-4fc2-af78-78b461cf80cf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:29.410681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb413f29-7984-4fc2-af78-78b461cf80cf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:29.412956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 682/1350] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 03:56:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:29.427952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096a5a-96ad-4867-a757-ec4dbde4633a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:29.427952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096a5a-96ad-4867-a757-ec4dbde4633a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:29.427952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58096a5a-96ad-4867-a757-ec4dbde4633a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:29.527519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-58096a5a-96ad-4867-a757-ec4dbde4633a None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:29.528891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-58096a5a-96ad-4867-a757-ec4dbde4633a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:29.610273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 669/1351] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 03:56:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:33.720779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5624f9-dc93-4f9c-b2a1-56bb7e81c25f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:33.721281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5624f9-dc93-4f9c-b2a1-56bb7e81c25f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:33.721281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5624f9-dc93-4f9c-b2a1-56bb7e81c25f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:33.722946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 683/1352] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 03:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:33.728015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f2d5-03de-4a5a-aeaa-7caf207248a4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:33.728518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f2d5-03de-4a5a-aeaa-7caf207248a4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:33.728609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c4f2d5-03de-4a5a-aeaa-7caf207248a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:33.748103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-74c4f2d5-03de-4a5a-aeaa-7caf207248a4 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:33.749354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74c4f2d5-03de-4a5a-aeaa-7caf207248a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:33.759413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 670/1353] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 03:56:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:34.434316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=13 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:35.120851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d3b-a0d4-4ce0-9dcd-0d0ba599f2de None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:35.121540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d3b-a0d4-4ce0-9dcd-0d0ba599f2de None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:35.121540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67625d3b-a0d4-4ce0-9dcd-0d0ba599f2de None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:35.123150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 684/1354] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 03:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:35.128719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e617c2-f945-4533-a620-c1cf1e549728 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:35.129174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e617c2-f945-4533-a620-c1cf1e549728 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:35.129253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e617c2-f945-4533-a620-c1cf1e549728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:35.147315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-17e617c2-f945-4533-a620-c1cf1e549728 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:35.148533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-17e617c2-f945-4533-a620-c1cf1e549728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:35.157493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 671/1355] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 03:56:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:38.773605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055625-5ea4-4171-a4d7-10fea994b89b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:38.774188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055625-5ea4-4171-a4d7-10fea994b89b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:38.774188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b055625-5ea4-4171-a4d7-10fea994b89b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:38.775806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 685/1356] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:38.781498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9cd5-dda6-440d-9670-19021006bbd1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:38.782331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9cd5-dda6-440d-9670-19021006bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:38.782766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf9cd5-dda6-440d-9670-19021006bbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:38.805063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7ecf9cd5-dda6-440d-9670-19021006bbd1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:38.806304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7ecf9cd5-dda6-440d-9670-19021006bbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:38.814466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 672/1357] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:38.872398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5128cc-a1bc-427a-b80a-071839e3bb0f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:38.872719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5128cc-a1bc-427a-b80a-071839e3bb0f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:38.872949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5128cc-a1bc-427a-b80a-071839e3bb0f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:38.874607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 686/1358] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jul 7 03:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:38.884858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa1b62-cdaa-4ab6-b4f8-39a827f18d91 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:38.885143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa1b62-cdaa-4ab6-b4f8-39a827f18d91 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:38.885434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa1b62-cdaa-4ab6-b4f8-39a827f18d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:38.935122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:38.945627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5baa1b62-cdaa-4ab6-b4f8-39a827f18d91 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:38.946879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5baa1b62-cdaa-4ab6-b4f8-39a827f18d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:39.031264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 673/1359] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jul 7 03:56:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:39.040872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5128cc-a1bc-427a-b80a-071839e3bb0f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:39.057616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5128cc-a1bc-427a-b80a-071839e3bb0f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:39.063119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:39.063767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:39.064040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:39.064334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:39.073247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:39.074879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925385f7-6cc7-48b9-85b2-928f6dc45033 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:39.085444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 687/1360] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:41.298350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387002-e946-48c1-92ab-e3f6f476c923 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:41.298899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387002-e946-48c1-92ab-e3f6f476c923 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:41.299494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c387002-e946-48c1-92ab-e3f6f476c923 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:41.301066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 674/1361] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:41.306741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd656-daab-4a45-978f-1fd78bd7a9f1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:41.307223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd656-daab-4a45-978f-1fd78bd7a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:41.307318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cdd656-daab-4a45-978f-1fd78bd7a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:41.325718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e8cdd656-daab-4a45-978f-1fd78bd7a9f1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:41.326911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e8cdd656-daab-4a45-978f-1fd78bd7a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:41.335175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 688/1362] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:41.379728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c387002-e946-48c1-92ab-e3f6f476c923 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:41.394823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c387002-e946-48c1-92ab-e3f6f476c923 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:41.400439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:41.401109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:41.401388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:41.401652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:41.410293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:41.411889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b070bccb-15fd-43a3-84ab-11bf71462b2a service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:41.421537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 675/1363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:43.730183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6abc1-c767-4691-ab88-684a6d7e8371 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:43.730653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6abc1-c767-4691-ab88-684a6d7e8371 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:43.730747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b6abc1-c767-4691-ab88-684a6d7e8371 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:43.732193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 689/1364] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:43.742195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18cf9-c2fa-44d6-bb49-4e21fc0f01e2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:43.742656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18cf9-c2fa-44d6-bb49-4e21fc0f01e2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:43.742778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b18cf9-c2fa-44d6-bb49-4e21fc0f01e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:43.761711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b0b18cf9-c2fa-44d6-bb49-4e21fc0f01e2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:43.763151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b0b18cf9-c2fa-44d6-bb49-4e21fc0f01e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:43.772820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 676/1365] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:43.820557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0557-fcc5-4b76-a75a-477856a8b3f9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:43.820781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0557-fcc5-4b76-a75a-477856a8b3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:43.821081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c0557-fcc5-4b76-a75a-477856a8b3f9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:43.825929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 690/1366] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jul 7 03:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:43.827863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689f0c-3ee0-4ac5-a2b0-e6ea752e89a5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:43.828559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689f0c-3ee0-4ac5-a2b0-e6ea752e89a5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:43.828834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e689f0c-3ee0-4ac5-a2b0-e6ea752e89a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:43.846825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5e689f0c-3ee0-4ac5-a2b0-e6ea752e89a5 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:43.847997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5e689f0c-3ee0-4ac5-a2b0-e6ea752e89a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:43.857209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 677/1367] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jul 7 03:56:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:43.864945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0557-fcc5-4b76-a75a-477856a8b3f9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:43.881241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c0557-fcc5-4b76-a75a-477856a8b3f9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:43.887666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25168c00-5086-49a1-a093-f07948882128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:43.888379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25168c00-5086-49a1-a093-f07948882128 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:43.888657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25168c00-5086-49a1-a093-f07948882128 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:43.888925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25168c00-5086-49a1-a093-f07948882128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:43.897310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25168c00-5086-49a1-a093-f07948882128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:43.898908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25168c00-5086-49a1-a093-f07948882128 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:43.910935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 691/1368] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:45.969867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d983e-11cd-4c54-a501-4d4accfd3382 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:45.970390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d983e-11cd-4c54-a501-4d4accfd3382 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:45.970669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d983e-11cd-4c54-a501-4d4accfd3382 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:45.972222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 678/1369] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:45.977471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0335-92fb-4dc3-86e4-aec901706d89 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:45.977890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0335-92fb-4dc3-86e4-aec901706d89 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:45.977976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c0335-92fb-4dc3-86e4-aec901706d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:45.996163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-af1c0335-92fb-4dc3-86e4-aec901706d89 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:45.997391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-af1c0335-92fb-4dc3-86e4-aec901706d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:46.005492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 692/1370] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:46.049737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d983e-11cd-4c54-a501-4d4accfd3382 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:46.066307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d983e-11cd-4c54-a501-4d4accfd3382 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:46.072523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:46.073209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:46.073487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:46.073757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:46.083810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:46.085782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dcf514-56fb-4e69-b1d2-070be8be1b8f service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:46.097131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 679/1371] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:46.767158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f630b-8c71-4f9b-b018-0a6d167513aa None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:46.767749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f630b-8c71-4f9b-b018-0a6d167513aa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:46.768024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7f630b-8c71-4f9b-b018-0a6d167513aa None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:46.769633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 693/1372] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:46.775190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcceb8-5fd5-4311-a1f9-c7af69ab88de None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:46.775443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcceb8-5fd5-4311-a1f9-c7af69ab88de None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:46.775924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcceb8-5fd5-4311-a1f9-c7af69ab88de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:46.795335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c2bcceb8-5fd5-4311-a1f9-c7af69ab88de None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:46.796582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c2bcceb8-5fd5-4311-a1f9-c7af69ab88de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:46.805479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 680/1373] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:47.143479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602107f-1e75-445b-bb45-d2ce257e2e12 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:47.143479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602107f-1e75-445b-bb45-d2ce257e2e12 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:47.143479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602107f-1e75-445b-bb45-d2ce257e2e12 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:47.145725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 694/1374] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jul 7 03:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:47.150673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab38c8-ddba-46ed-82c3-723e2391f272 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:47.151247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab38c8-ddba-46ed-82c3-723e2391f272 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:47.151247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab38c8-ddba-46ed-82c3-723e2391f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:47.202394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1fab38c8-ddba-46ed-82c3-723e2391f272 None None] MFA Rules not processed for user `f777aaf6bb714c8c949105aa8556c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:47.203579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1fab38c8-ddba-46ed-82c3-723e2391f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:47.268513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 681/1375] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jul 7 03:56:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:47.275980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602107f-1e75-445b-bb45-d2ce257e2e12 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:47.287276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602107f-1e75-445b-bb45-d2ce257e2e12 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:47.291153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:47.291793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:47.292066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:47.292436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:47.301758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:47.303196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c83978c-28c5-4c26-adeb-bf433e19f292 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:47.313358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 695/1376] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:48.145102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5fcf-4139-41ed-9f7b-85cb1e67065f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:48.145429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5fcf-4139-41ed-9f7b-85cb1e67065f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:48.145725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b5fcf-4139-41ed-9f7b-85cb1e67065f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:48.149607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 682/1377] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:48.155809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcc2e-3e02-4b01-b086-0c6ef2895297 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:48.156768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcc2e-3e02-4b01-b086-0c6ef2895297 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:48.157236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bcc2e-3e02-4b01-b086-0c6ef2895297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:48.175533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1e0bcc2e-3e02-4b01-b086-0c6ef2895297 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:48.176791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1e0bcc2e-3e02-4b01-b086-0c6ef2895297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:48.184771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 696/1378] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:48.228525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5fcf-4139-41ed-9f7b-85cb1e67065f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:48.243914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b5fcf-4139-41ed-9f7b-85cb1e67065f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:48.249875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:48.250541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:48.250803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:48.251075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:48.259843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:48.261498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102e50e-4c9c-43aa-82e7-817841eecd30 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:48.265591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:56:48.272389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 683/1379] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:50.326750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288950-6a3a-4c75-b6bf-13959b38efac None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:50.327882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288950-6a3a-4c75-b6bf-13959b38efac None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:50.328402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54288950-6a3a-4c75-b6bf-13959b38efac None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:50.330316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 697/1380] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:50.336163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d768-293e-437b-a725-0203c6710b3c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:50.337088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d768-293e-437b-a725-0203c6710b3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:50.337604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7d768-293e-437b-a725-0203c6710b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:50.356683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-79b7d768-293e-437b-a725-0203c6710b3c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:50.357835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-79b7d768-293e-437b-a725-0203c6710b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:50.365969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 684/1381] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:50.414212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54288950-6a3a-4c75-b6bf-13959b38efac None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:50.430156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54288950-6a3a-4c75-b6bf-13959b38efac None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:50.436620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:50.437281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:50.437835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:50.438118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:50.446350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:50.447960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a572819b-6280-46dd-9b97-34dc6c898f53 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:50.457273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 698/1382] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:52.539847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68f92-966d-40cb-b07e-1fe6031ce1ed None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:52.540545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68f92-966d-40cb-b07e-1fe6031ce1ed None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:52.540545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb68f92-966d-40cb-b07e-1fe6031ce1ed None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:52.541842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 685/1383] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:52.547454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039981cf-3462-4495-ba64-fa497524e297 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:52.547906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039981cf-3462-4495-ba64-fa497524e297 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:52.548232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039981cf-3462-4495-ba64-fa497524e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:52.566949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-039981cf-3462-4495-ba64-fa497524e297 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:52.568304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-039981cf-3462-4495-ba64-fa497524e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:52.580496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 699/1384] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:52.618615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68f92-966d-40cb-b07e-1fe6031ce1ed None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:52.635182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb68f92-966d-40cb-b07e-1fe6031ce1ed None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:52.641165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:52.641858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:52.642135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:52.642409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:52.651514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:52.653173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35be67-f69d-4d46-8eb9-831a5d174951 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:52.662982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 686/1385] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:54.700327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ce89e-bc16-436a-88ac-bdb2d8e566a1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:54.700790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ce89e-bc16-436a-88ac-bdb2d8e566a1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:54.700966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ce89e-bc16-436a-88ac-bdb2d8e566a1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:54.708340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 700/1386] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:54.708543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10327-669a-44d9-a68a-86eeafe4d80f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:54.708543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10327-669a-44d9-a68a-86eeafe4d80f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:54.708543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a10327-669a-44d9-a68a-86eeafe4d80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:54.734736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d3a10327-669a-44d9-a68a-86eeafe4d80f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:54.735929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d3a10327-669a-44d9-a68a-86eeafe4d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:54.752553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 687/1387] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:54.795484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ce89e-bc16-436a-88ac-bdb2d8e566a1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:54.810374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ce89e-bc16-436a-88ac-bdb2d8e566a1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:54.815915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:54.816606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:54.816890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:54.817166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:54.826053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:54.827676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55d816-a55d-4996-b620-0af36b6010d0 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:54.837357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 701/1388] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:56.916563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f038d-8361-4815-861f-418c54d01a10 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:56.917159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f038d-8361-4815-861f-418c54d01a10 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:56.917159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f038d-8361-4815-861f-418c54d01a10 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:56.918532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 688/1389] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:56.924488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93ed-75c6-4412-aec3-d5f044291dae None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:56.924929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93ed-75c6-4412-aec3-d5f044291dae None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:56.925040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93ed-75c6-4412-aec3-d5f044291dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:56.953635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e5d93ed-75c6-4412-aec3-d5f044291dae None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:56.954901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e5d93ed-75c6-4412-aec3-d5f044291dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:56.963853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 702/1390] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:57.008104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f038d-8361-4815-861f-418c54d01a10 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:57.023879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f038d-8361-4815-861f-418c54d01a10 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:57.029735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:57.030390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:57.030668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:57.030918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:57.039365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:57.041095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baecd75-7d8b-4722-8c5a-2604ce070a1e service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:57.050649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 689/1391] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:56:59.402442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62e51a-4e59-4b2b-aa0c-cba323a739e0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:59.403038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62e51a-4e59-4b2b-aa0c-cba323a739e0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:59.403038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62e51a-4e59-4b2b-aa0c-cba323a739e0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:59.404500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 703/1392] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:56:59.411224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b31c-4a4f-424a-b799-554587f68d3d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:59.411699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b31c-4a4f-424a-b799-554587f68d3d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:59.411797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df70b31c-4a4f-424a-b799-554587f68d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:59.430198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-df70b31c-4a4f-424a-b799-554587f68d3d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:56:59.431489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df70b31c-4a4f-424a-b799-554587f68d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:56:59.439652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 690/1393] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:56:59.485190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62e51a-4e59-4b2b-aa0c-cba323a739e0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:56:59.500143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62e51a-4e59-4b2b-aa0c-cba323a739e0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:56:59.505829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:56:59.506492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:56:59.506769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:56:59.507034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:56:59.515750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:56:59.517472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54daf7-d67f-458d-a398-8838e88252a8 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:56:59.527346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 704/1394] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:01.584433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423494-2ea8-4e72-8f0b-3f55125eafb5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:01.584988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423494-2ea8-4e72-8f0b-3f55125eafb5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:01.584988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65423494-2ea8-4e72-8f0b-3f55125eafb5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:01.586369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 691/1395] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:01.592220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54269c25-c5ca-4af6-bade-d56114c8ef6d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:01.592672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54269c25-c5ca-4af6-bade-d56114c8ef6d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:01.592787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54269c25-c5ca-4af6-bade-d56114c8ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:01.611626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-54269c25-c5ca-4af6-bade-d56114c8ef6d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:01.612887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-54269c25-c5ca-4af6-bade-d56114c8ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:01.621567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 705/1396] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:57:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:01.665051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65423494-2ea8-4e72-8f0b-3f55125eafb5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:01.680352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65423494-2ea8-4e72-8f0b-3f55125eafb5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:01.686586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:01.687265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:01.687542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:01.687818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:01.696454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:01.698078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca42042-3e00-4c2b-895e-05d75c38cfef service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:01.707530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 692/1397] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:02.403624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf801-5dfb-4b7d-ba27-33e965f91df0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:02.403943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf801-5dfb-4b7d-ba27-33e965f91df0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:02.404154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cf801-5dfb-4b7d-ba27-33e965f91df0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:02.405781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 706/1398] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:02.411042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ed9e-7c92-444d-a252-35778461fd15 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:02.411331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ed9e-7c92-444d-a252-35778461fd15 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:02.411605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f0ed9e-7c92-444d-a252-35778461fd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:02.430701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-59f0ed9e-7c92-444d-a252-35778461fd15 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:02.432067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-59f0ed9e-7c92-444d-a252-35778461fd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:02.440735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 693/1399] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:02.501625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01366-3f47-4a1f-88e4-c48d8d9aa9ee None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:02.501934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01366-3f47-4a1f-88e4-c48d8d9aa9ee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:02.502209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d01366-3f47-4a1f-88e4-c48d8d9aa9ee None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:02.503619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 707/1400] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jul 7 03:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:02.508945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd539-8ce8-44b7-bc3e-7a46c06228f3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:02.509231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd539-8ce8-44b7-bc3e-7a46c06228f3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:02.509501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bdd539-8ce8-44b7-bc3e-7a46c06228f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:02.560979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-26bdd539-8ce8-44b7-bc3e-7a46c06228f3 None None] MFA Rules not processed for user `068cf00a56cc488586b207a13592f6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:02.562204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-26bdd539-8ce8-44b7-bc3e-7a46c06228f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:02.626199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 694/1401] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jul 7 03:57:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:02.634479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d01366-3f47-4a1f-88e4-c48d8d9aa9ee None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:02.646143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d01366-3f47-4a1f-88e4-c48d8d9aa9ee None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:02.650204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:02.650876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:02.651156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:02.651413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:02.660983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:02.662386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c2ec-3197-4458-bfaa-49638a287fc7 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:02.672228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 708/1402] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:03.394384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b5bc-db91-470f-a7f9-3a457cdf2562 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.394676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b5bc-db91-470f-a7f9-3a457cdf2562 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.394948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b432b5bc-db91-470f-a7f9-3a457cdf2562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.443143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b432b5bc-db91-470f-a7f9-3a457cdf2562 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:03.444392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b432b5bc-db91-470f-a7f9-3a457cdf2562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:03.487310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:57:03.512824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 695/1403] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 03:57:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:03.556908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d06dd-8b64-4891-a824-3f7a8ea4927b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.557258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d06dd-8b64-4891-a824-3f7a8ea4927b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.557596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d06dd-8b64-4891-a824-3f7a8ea4927b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.559065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 709/1404] 10.222.0.26 () {54 vars in 942 bytes} [Thu Jul 7 03:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:03.565524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524ccb-7f91-4a53-874e-f5d9ae3edc5c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.565883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524ccb-7f91-4a53-874e-f5d9ae3edc5c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.566152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3524ccb-7f91-4a53-874e-f5d9ae3edc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.616318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d3524ccb-7f91-4a53-874e-f5d9ae3edc5c None None] MFA Rules not processed for user `48a2ed589c5742d3acd30e59e9f1da2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:03.617569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d3524ccb-7f91-4a53-874e-f5d9ae3edc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:03.690612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 696/1405] 10.222.0.26 () {58 vars in 1039 bytes} [Thu Jul 7 03:57:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:03.700020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d06dd-8b64-4891-a824-3f7a8ea4927b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:03.715159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d06dd-8b64-4891-a824-3f7a8ea4927b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:03.721309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:03.721982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.722273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.722540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.731469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:03.733116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6cf42-1e8e-45bd-90f5-5cb9dea5fd75 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:03.741294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 710/1406] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 03:57:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 03:57:03.750051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f296e-f0dc-4f13-b097-e1c4080f6359 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.750051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f296e-f0dc-4f13-b097-e1c4080f6359 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.750294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f296e-f0dc-4f13-b097-e1c4080f6359 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.751716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 697/1407] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:03.756993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463338-040d-4df8-8a67-09fd962674f2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.757363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463338-040d-4df8-8a67-09fd962674f2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.757641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f463338-040d-4df8-8a67-09fd962674f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.777384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8f463338-040d-4df8-8a67-09fd962674f2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:03.778598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8f463338-040d-4df8-8a67-09fd962674f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:03.787348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 711/1408] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:57:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:03.831877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f296e-f0dc-4f13-b097-e1c4080f6359 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:03.850082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f296e-f0dc-4f13-b097-e1c4080f6359 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:03.857152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:03.859814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:03.859814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:03.859814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:03.870926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:03.872862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc940303-6ebb-4a56-a162-46bd98b0e6cc service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:03.892307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 698/1409] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:13.771730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=69 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:57:13.879063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=59 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:57:25.611866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f798e-71a7-4eda-a80c-03be7445e820 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:25.612493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f798e-71a7-4eda-a80c-03be7445e820 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:25.612493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f798e-71a7-4eda-a80c-03be7445e820 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:25.613836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 712/1410] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jul 7 03:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:25.620264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe470b-e0db-46c0-aa8f-14bac14cfa88 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:25.620699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe470b-e0db-46c0-aa8f-14bac14cfa88 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:25.620819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe470b-e0db-46c0-aa8f-14bac14cfa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:25.640135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-52fe470b-e0db-46c0-aa8f-14bac14cfa88 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:25.641352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-52fe470b-e0db-46c0-aa8f-14bac14cfa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:25.651385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 699/1411] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jul 7 03:57:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:25.665664 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1437-35f5-4c79-8b63-922f98552822 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:25.665943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1437-35f5-4c79-8b63-922f98552822 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:25.666216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174f1437-35f5-4c79-8b63-922f98552822 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:25.667578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 713/1412] 10.222.0.26 () {54 vars in 918 bytes} [Thu Jul 7 03:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:25.672489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767dbf-71fc-4806-935c-80edb14b02fb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:25.672778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767dbf-71fc-4806-935c-80edb14b02fb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:25.673051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2767dbf-71fc-4806-935c-80edb14b02fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:25.692778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d2767dbf-71fc-4806-935c-80edb14b02fb None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:25.693969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2767dbf-71fc-4806-935c-80edb14b02fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:25.704144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 700/1413] 10.222.0.26 () {58 vars in 1015 bytes} [Thu Jul 7 03:57:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:28.161046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ce02-bcbc-49ed-b3da-b35a3d79b961 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:28.161935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ce02-bcbc-49ed-b3da-b35a3d79b961 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:28.161935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e932ce02-bcbc-49ed-b3da-b35a3d79b961 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:28.164069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:28.172546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaf780-3c7d-4ea9-a211-fc8bd2e2a548 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:28.173231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaf780-3c7d-4ea9-a211-fc8bd2e2a548 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:28.173425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeaf780-3c7d-4ea9-a211-fc8bd2e2a548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:28.196757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0eeaf780-3c7d-4ea9-a211-fc8bd2e2a548 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:28.197971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0eeaf780-3c7d-4ea9-a211-fc8bd2e2a548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:28.208280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:28.253035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ce02-bcbc-49ed-b3da-b35a3d79b961 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:28.269122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e932ce02-bcbc-49ed-b3da-b35a3d79b961 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:28.274999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:28.275641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:28.275921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:28.276242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:28.285009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:28.286628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed3081-a632-44cb-81e9-b2d939ed8558 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:28.296610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 715/1416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:29.192191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4993-19f2-44b0-a126-689f86b57f94 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:29.192720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4993-19f2-44b0-a126-689f86b57f94 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:29.192720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a4993-19f2-44b0-a126-689f86b57f94 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:29.194754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:29.200020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcdef-bda4-4456-a593-8d4907b215a2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:29.200504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcdef-bda4-4456-a593-8d4907b215a2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:29.200596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bfcdef-bda4-4456-a593-8d4907b215a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:29.221142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-74bfcdef-bda4-4456-a593-8d4907b215a2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:29.222327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-74bfcdef-bda4-4456-a593-8d4907b215a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:29.231571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:29.382425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4993-19f2-44b0-a126-689f86b57f94 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:29.399046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a4993-19f2-44b0-a126-689f86b57f94 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:29.406357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:29.407004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:29.407282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:29.407552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:29.416427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:29.418052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea981e6f-0e89-4b36-ae24-95bac568baf8 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:29.427884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 703/1419] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:30.301044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dc87-74ff-4547-a85c-3495c9b21eae None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:30.301595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dc87-74ff-4547-a85c-3495c9b21eae None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:30.301595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560dc87-74ff-4547-a85c-3495c9b21eae None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:30.303003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:30.309251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969641-d4a9-489d-8a0c-febea93d1bc4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:30.309974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969641-d4a9-489d-8a0c-febea93d1bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:30.310107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4969641-d4a9-489d-8a0c-febea93d1bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:30.333713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d4969641-d4a9-489d-8a0c-febea93d1bc4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:30.334893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4969641-d4a9-489d-8a0c-febea93d1bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:30.344243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:30.505862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560dc87-74ff-4547-a85c-3495c9b21eae None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:30.524052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560dc87-74ff-4547-a85c-3495c9b21eae None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:30.529990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:30.530645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:30.530943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:30.531212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:30.542125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:30.544558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7a345-8a55-40ec-86ac-0d393ead459f service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:30.559975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 718/1422] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:31.423903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068bd2-4e9f-4eeb-9acc-5f8c2fdd6450 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:31.424823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068bd2-4e9f-4eeb-9acc-5f8c2fdd6450 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:31.424823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d068bd2-4e9f-4eeb-9acc-5f8c2fdd6450 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:31.426987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:31.435304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b259cc-acd8-41d7-8856-ca8f913106b8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:31.436003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b259cc-acd8-41d7-8856-ca8f913106b8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:31.436221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b259cc-acd8-41d7-8856-ca8f913106b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:31.459179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d7b259cc-acd8-41d7-8856-ca8f913106b8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:31.460429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d7b259cc-acd8-41d7-8856-ca8f913106b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:31.469213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:31.618288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068bd2-4e9f-4eeb-9acc-5f8c2fdd6450 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:31.636833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d068bd2-4e9f-4eeb-9acc-5f8c2fdd6450 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:31.646598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:31.647634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:31.648037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:31.648476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:31.658463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:31.660084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10932625-608f-46ed-acd6-b9b8d2792df7 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:31.670463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 706/1425] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:32.529656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0f11-553e-43f3-a4da-789e837eddff None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:32.530595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0f11-553e-43f3-a4da-789e837eddff None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:32.530595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d0f11-553e-43f3-a4da-789e837eddff None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:32.532943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:32.541103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8431-4431-4218-93ed-032c61badd2c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:32.541586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8431-4431-4218-93ed-032c61badd2c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:32.541707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a8431-4431-4218-93ed-032c61badd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:32.568098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-420a8431-4431-4218-93ed-032c61badd2c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:32.569399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-420a8431-4431-4218-93ed-032c61badd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:32.577741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:32.733728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0f11-553e-43f3-a4da-789e837eddff None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:32.751857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d0f11-553e-43f3-a4da-789e837eddff None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:32.759783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:32.760452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:32.760726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:32.761121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:32.770194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:32.771784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e23feb-fd3a-42fc-ab13-12a2723e62c4 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:32.781623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 721/1428] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:33.618640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dabc-fc39-453d-a6bb-c27f65e66cb3 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:33.619563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dabc-fc39-453d-a6bb-c27f65e66cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:33.619563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305dabc-fc39-453d-a6bb-c27f65e66cb3 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:33.621786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:33.629306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dcab7-afb9-42dc-b321-56cea778494e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:33.629754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dcab7-afb9-42dc-b321-56cea778494e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:33.629909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030dcab7-afb9-42dc-b321-56cea778494e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:33.654693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-030dcab7-afb9-42dc-b321-56cea778494e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:33.656564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-030dcab7-afb9-42dc-b321-56cea778494e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:33.669982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 03:57:33.821112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305dabc-fc39-453d-a6bb-c27f65e66cb3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:33.840669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305dabc-fc39-453d-a6bb-c27f65e66cb3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:33.849011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:33.849775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:33.850087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:33.850479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:33.863596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:33.866007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5523638-19fb-4ba9-b349-b44c5856ae57 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:33.877518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 709/1431] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:34.667038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0d03-f87e-448d-a38b-7223e6b9375e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:34.667634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0d03-f87e-448d-a38b-7223e6b9375e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:34.667634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d0d03-f87e-448d-a38b-7223e6b9375e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:34.669060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:34.675102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aeacd-be3e-46c4-8237-c6ed35cb2234 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:34.675828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aeacd-be3e-46c4-8237-c6ed35cb2234 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:34.676172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5aeacd-be3e-46c4-8237-c6ed35cb2234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:34.697590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6c5aeacd-be3e-46c4-8237-c6ed35cb2234 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:34.698798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6c5aeacd-be3e-46c4-8237-c6ed35cb2234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:34.706919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:34.859889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0d03-f87e-448d-a38b-7223e6b9375e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:34.880411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d0d03-f87e-448d-a38b-7223e6b9375e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:34.890237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:34.891251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:34.891702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:34.892170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:34.905351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:34.906962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41957877-0af7-4aa1-a08c-e85e5285edf6 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:34.916907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 724/1434] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:35.717906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7976c2-47bf-4e11-b97e-87c963452bb0 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:35.718492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7976c2-47bf-4e11-b97e-87c963452bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:35.718492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7976c2-47bf-4e11-b97e-87c963452bb0 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:35.719839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:35.725938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5faa9-dd7c-48b0-a6f9-2c7ba1296cd4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:35.726369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5faa9-dd7c-48b0-a6f9-2c7ba1296cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:35.726472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5faa9-dd7c-48b0-a6f9-2c7ba1296cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:35.747663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b2c5faa9-dd7c-48b0-a6f9-2c7ba1296cd4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:35.748880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b2c5faa9-dd7c-48b0-a6f9-2c7ba1296cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:35.757340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:35.907288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7976c2-47bf-4e11-b97e-87c963452bb0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:35.924896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7976c2-47bf-4e11-b97e-87c963452bb0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:35.931976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:35.932655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:35.932935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:35.933172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:35.942534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:35.944132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a5bcf-03f3-4c78-a639-2698bcbacc22 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:35.954024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 712/1437] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:36.750434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6ef4-6a00-4bfc-89c8-ed55997b44f2 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:36.751028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6ef4-6a00-4bfc-89c8-ed55997b44f2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:36.751028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004d6ef4-6a00-4bfc-89c8-ed55997b44f2 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:36.752387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 03:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:36.758397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97567-ae81-425a-b644-bf3933e5e1eb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:36.759144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97567-ae81-425a-b644-bf3933e5e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:36.759429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a97567-ae81-425a-b644-bf3933e5e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:36.781915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c3a97567-ae81-425a-b644-bf3933e5e1eb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:36.783125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c3a97567-ae81-425a-b644-bf3933e5e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:36.792582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 03:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:36.942085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d6ef4-6a00-4bfc-89c8-ed55997b44f2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:36.958810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004d6ef4-6a00-4bfc-89c8-ed55997b44f2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:36.965016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:36.965654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:36.965928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:36.966199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:36.974364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:36.975957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ca535-c0f8-4cb2-b2df-63ad0c8a5587 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:36.986106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 727/1440] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:38.889614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5441-ad2f-4da0-9c32-8744e9abdd3c None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:38.890477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5441-ad2f-4da0-9c32-8744e9abdd3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:38.890477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc5441-ad2f-4da0-9c32-8744e9abdd3c None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:38.892631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:38.898697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637303b1-3272-45ad-b41f-1a7030a4648b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:38.899391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637303b1-3272-45ad-b41f-1a7030a4648b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:38.899535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637303b1-3272-45ad-b41f-1a7030a4648b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:38.922179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-637303b1-3272-45ad-b41f-1a7030a4648b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:38.923366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-637303b1-3272-45ad-b41f-1a7030a4648b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:38.932328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:38.970624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5441-ad2f-4da0-9c32-8744e9abdd3c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:38.983217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc5441-ad2f-4da0-9c32-8744e9abdd3c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:38.987473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:38.988143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:38.988426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:38.988689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:38.998495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:38.999920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d91c4d0-3559-4d6f-b22d-9147202d21f1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:39.009419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 715/1443] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:41.157138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0e41-f3ef-4904-b1c0-882d0e2a76a9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:41.158357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0e41-f3ef-4904-b1c0-882d0e2a76a9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:41.158357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b0e41-f3ef-4904-b1c0-882d0e2a76a9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:41.160531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:41.165957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b67cd-55a6-4ee5-a582-da8c85a623f5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:41.166390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b67cd-55a6-4ee5-a582-da8c85a623f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:41.166500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b67cd-55a6-4ee5-a582-da8c85a623f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:41.194551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-488b67cd-55a6-4ee5-a582-da8c85a623f5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:41.196268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-488b67cd-55a6-4ee5-a582-da8c85a623f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:41.207060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:41.247923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b0e41-f3ef-4904-b1c0-882d0e2a76a9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:41.260548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b0e41-f3ef-4904-b1c0-882d0e2a76a9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:41.264171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:41.264838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:41.265114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:41.265385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:41.274448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:41.275889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fc694-66ae-43ba-a79d-27298c8e628b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:41.285459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 730/1446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:43.601591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e293-a00e-4da2-a073-d62a031ebd32 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:43.602142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e293-a00e-4da2-a073-d62a031ebd32 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:43.602142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed7e293-a00e-4da2-a073-d62a031ebd32 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:43.603505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:43.610066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f288-38de-4ad5-84ed-b39265019614 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:43.610756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f288-38de-4ad5-84ed-b39265019614 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:43.610905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3f288-38de-4ad5-84ed-b39265019614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:43.635326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7eb3f288-38de-4ad5-84ed-b39265019614 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:43.637200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7eb3f288-38de-4ad5-84ed-b39265019614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:43.650291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:43.687818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e293-a00e-4da2-a073-d62a031ebd32 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:43.699249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed7e293-a00e-4da2-a073-d62a031ebd32 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:43.703299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:43.703933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:43.704309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:43.704579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:43.714988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:43.717162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532a0ce-cf2d-456c-810d-f5e9c606a75e service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:43.730419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 718/1449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 03:57:45.865406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485b150-488b-4f20-beea-e523f6925482 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:45.866020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485b150-488b-4f20-beea-e523f6925482 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:45.866020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6485b150-488b-4f20-beea-e523f6925482 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:45.867387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:45.873850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5215a8-c054-4174-848a-853d89aff85c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:45.874584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5215a8-c054-4174-848a-853d89aff85c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:45.874757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5215a8-c054-4174-848a-853d89aff85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:45.903611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-df5215a8-c054-4174-848a-853d89aff85c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:45.904862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df5215a8-c054-4174-848a-853d89aff85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:45.914246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:45.952611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485b150-488b-4f20-beea-e523f6925482 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:45.965523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6485b150-488b-4f20-beea-e523f6925482 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:45.969297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:45.969934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:45.970210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:45.970475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:45.980034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:45.981506 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ba6b2-94ce-40f2-863c-8598a9340b61 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:45.991163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 733/1452] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:48.056007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189425-d597-401b-b486-d11a022a34e9 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:48.056829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189425-d597-401b-b486-d11a022a34e9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:48.056829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de189425-d597-401b-b486-d11a022a34e9 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:48.058835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:48.064476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb6c2-39cc-4a89-8ae6-5b66681c4a25 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:48.064922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb6c2-39cc-4a89-8ae6-5b66681c4a25 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:48.065056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143bb6c2-39cc-4a89-8ae6-5b66681c4a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:48.084470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-143bb6c2-39cc-4a89-8ae6-5b66681c4a25 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:48.085583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-143bb6c2-39cc-4a89-8ae6-5b66681c4a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:48.095595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:48.133295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189425-d597-401b-b486-d11a022a34e9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:48.151609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de189425-d597-401b-b486-d11a022a34e9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:48.156221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:48.156859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:48.157134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:48.157395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:48.167515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:48.169001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa98b0a-c5c3-4c07-98a2-7968a9488e32 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:48.178759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 721/1455] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:50.242389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526603c-9e75-4600-a03e-304c87b02bf3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:50.242925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526603c-9e75-4600-a03e-304c87b02bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:50.242925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526603c-9e75-4600-a03e-304c87b02bf3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:50.245140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:50.254290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729761-3162-49b1-8e81-eaeae8070ac6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:50.254684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729761-3162-49b1-8e81-eaeae8070ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:50.254904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35729761-3162-49b1-8e81-eaeae8070ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:50.275307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-35729761-3162-49b1-8e81-eaeae8070ac6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:50.276530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-35729761-3162-49b1-8e81-eaeae8070ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:50.285019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:50.325705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526603c-9e75-4600-a03e-304c87b02bf3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:50.337883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526603c-9e75-4600-a03e-304c87b02bf3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:50.342144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:50.342782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:50.343049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:50.343327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:50.352668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:50.354107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3ed9b-2309-495b-a910-3539534b45cc service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:50.363691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 736/1458] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:52.414979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10dd6-d3eb-41ee-a94e-3bd60be42433 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:52.415580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10dd6-d3eb-41ee-a94e-3bd60be42433 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:52.415580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd10dd6-d3eb-41ee-a94e-3bd60be42433 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:52.416980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:52.423372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7856f9-66a7-4e15-80d5-8f28cf4f4e17 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:52.424150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7856f9-66a7-4e15-80d5-8f28cf4f4e17 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:52.424311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7856f9-66a7-4e15-80d5-8f28cf4f4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:52.452026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db7856f9-66a7-4e15-80d5-8f28cf4f4e17 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:52.453249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db7856f9-66a7-4e15-80d5-8f28cf4f4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:52.461795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:52.500804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd10dd6-d3eb-41ee-a94e-3bd60be42433 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:52.513254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd10dd6-d3eb-41ee-a94e-3bd60be42433 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:52.517326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:52.517976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:52.518248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:52.518512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:52.528159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:52.529580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be0fca-db34-40b4-beb2-e7776bde6cbe service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:52.546151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 724/1461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:54.610347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a306-f873-4994-82a2-2f812afa3dd6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:54.610915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a306-f873-4994-82a2-2f812afa3dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:54.610915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a306-f873-4994-82a2-2f812afa3dd6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:54.612306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:54.620592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28aca8-6fd6-4882-8616-830e6abbeb05 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:54.621035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28aca8-6fd6-4882-8616-830e6abbeb05 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:54.621131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28aca8-6fd6-4882-8616-830e6abbeb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:54.631537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=79 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:57:54.644532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9d28aca8-6fd6-4882-8616-830e6abbeb05 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:54.645723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d28aca8-6fd6-4882-8616-830e6abbeb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:54.654354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:54.692643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a306-f873-4994-82a2-2f812afa3dd6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:54.698995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=73 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:57:54.705377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a306-f873-4994-82a2-2f812afa3dd6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:54.708951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:54.709590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:54.709861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:54.710126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:54.719931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:54.721409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5118d2-636c-4ac4-a1f4-bab38987253c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:54.731211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 739/1464] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:56.829818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a29a-208f-47a3-84e0-f2d6954afe23 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:56.830721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a29a-208f-47a3-84e0-f2d6954afe23 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:56.830721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f4a29a-208f-47a3-84e0-f2d6954afe23 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:56.833018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:56.842059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9e02-d63b-469d-aa26-af13fe1646e9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:56.842495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9e02-d63b-469d-aa26-af13fe1646e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:56.842611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b9e02-d63b-469d-aa26-af13fe1646e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:56.865580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-211b9e02-d63b-469d-aa26-af13fe1646e9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:56.866779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-211b9e02-d63b-469d-aa26-af13fe1646e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:56.875815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:56.912420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a29a-208f-47a3-84e0-f2d6954afe23 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:56.929066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f4a29a-208f-47a3-84e0-f2d6954afe23 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:56.933409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:56.934098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:56.934373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:56.934650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:56.945687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:56.947129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739c5f0-45f3-442a-96ba-4c7fb95b35f2 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:56.957426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 727/1467] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:57:58.979585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cd13-797c-4d5e-8938-2f8fde05a9f6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:58.980150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cd13-797c-4d5e-8938-2f8fde05a9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:58.980150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471cd13-797c-4d5e-8938-2f8fde05a9f6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:58.981599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 03:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:57:58.988050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1162c3-2ba8-4d6d-846f-34483430858d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:58.988526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1162c3-2ba8-4d6d-846f-34483430858d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:58.988661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1162c3-2ba8-4d6d-846f-34483430858d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:59.017174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1a1162c3-2ba8-4d6d-846f-34483430858d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:57:59.018487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1a1162c3-2ba8-4d6d-846f-34483430858d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:57:59.028995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 03:57:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:57:59.065256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471cd13-797c-4d5e-8938-2f8fde05a9f6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:57:59.077787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471cd13-797c-4d5e-8938-2f8fde05a9f6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:57:59.083178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:57:59.084099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:57:59.084473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:57:59.084824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:57:59.100809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:57:59.103017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8d25f-52fe-4564-a46d-2c219c81457a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:57:59.114305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 742/1470] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:57:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:09.010165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=11 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:09.109804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=14 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:18.675221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b932ed-8b9b-4c5d-bf2d-a837092b4ef4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:18.675831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b932ed-8b9b-4c5d-bf2d-a837092b4ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:18.675831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b932ed-8b9b-4c5d-bf2d-a837092b4ef4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:18.677188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 729/1471] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:18.683698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca667-ad79-4cda-b924-cf1bffa91db3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:18.684613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca667-ad79-4cda-b924-cf1bffa91db3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:18.684807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ca667-ad79-4cda-b924-cf1bffa91db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:18.710023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-082ca667-ad79-4cda-b924-cf1bffa91db3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:18.711225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-082ca667-ad79-4cda-b924-cf1bffa91db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:18.721239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 743/1472] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:18.806055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7d6e-f292-44ad-84d0-2d1f200f1e08 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:18.806337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7d6e-f292-44ad-84d0-2d1f200f1e08 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:18.806627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941a7d6e-f292-44ad-84d0-2d1f200f1e08 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:18.808004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 730/1473] 10.222.0.26 () {54 vars in 962 bytes} [Thu Jul 7 03:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:18.813291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544f49-0266-413b-9b43-a4e434301d35 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:18.813578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544f49-0266-413b-9b43-a4e434301d35 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:18.813847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544f49-0266-413b-9b43-a4e434301d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:18.833173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8b544f49-0266-413b-9b43-a4e434301d35 None None] MFA Rules not processed for user `068cf00a56cc488586b207a13592f6e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:18.834360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8b544f49-0266-413b-9b43-a4e434301d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:18.842499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 744/1474] 10.222.0.26 () {58 vars in 1059 bytes} [Thu Jul 7 03:58:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:18.850036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7d6e-f292-44ad-84d0-2d1f200f1e08 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:18.862366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941a7d6e-f292-44ad-84d0-2d1f200f1e08 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:18.866486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:18.867119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:18.867397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:18.867670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:18.877174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:18.878605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05322f5-8e48-491e-96b7-2dfc9d52a9b7 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:18.888475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 731/1475] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:21.033646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4f51-bcd5-4c20-bc37-a1f5aef0c06c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:21.034218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4f51-bcd5-4c20-bc37-a1f5aef0c06c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:21.034218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f4f51-bcd5-4c20-bc37-a1f5aef0c06c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:21.035597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 745/1476] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:21.042146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4b7a-386b-41e4-8ddd-6148657eeded None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:21.042609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4b7a-386b-41e4-8ddd-6148657eeded None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:21.042719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d4b7a-386b-41e4-8ddd-6148657eeded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:21.067451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3f3d4b7a-386b-41e4-8ddd-6148657eeded None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:21.068700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3f3d4b7a-386b-41e4-8ddd-6148657eeded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:21.077403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 732/1477] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:21.102005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f4f51-bcd5-4c20-bc37-a1f5aef0c06c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:21.123622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f4f51-bcd5-4c20-bc37-a1f5aef0c06c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:21.129370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:21.130021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:21.130301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:21.130565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:21.131309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:21.133112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:58:21.133112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 03:58:21.133112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 03:58:21.134254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d78fb-25df-47fb-b951-8e99749b69cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:21.154247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 746/1478] 10.222.0.26 () {56 vars in 1108 bytes} [Thu Jul 7 03:58:21 2022] GET /identity/v3/projects => generated 2553 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:58:23.199366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1732-881a-4b52-b577-3d80b7d6ebec None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:23.199972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1732-881a-4b52-b577-3d80b7d6ebec None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:23.199972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec1732-881a-4b52-b577-3d80b7d6ebec None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:23.201337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 733/1479] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:23.206875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706045aa-a7e8-4258-bf2a-4f1f788f6a40 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:23.207317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706045aa-a7e8-4258-bf2a-4f1f788f6a40 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:23.207432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706045aa-a7e8-4258-bf2a-4f1f788f6a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:23.227903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-706045aa-a7e8-4258-bf2a-4f1f788f6a40 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:23.229148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-706045aa-a7e8-4258-bf2a-4f1f788f6a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:23.238696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 747/1480] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:23.286286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1732-881a-4b52-b577-3d80b7d6ebec None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:23.301709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec1732-881a-4b52-b577-3d80b7d6ebec None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:23.307785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:23.308461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:23.308760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:23.309026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:23.317416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:23.318997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197c545-778d-40f7-a82d-b83fd67e269d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:23.328522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 734/1481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:25.538656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726956b-269a-443f-a6d0-7a40fd980dde None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:25.539227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726956b-269a-443f-a6d0-7a40fd980dde None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:25.539227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726956b-269a-443f-a6d0-7a40fd980dde None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:25.541400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 748/1482] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:25.546855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac933-ddf6-4b84-bc10-9f3d46ab8611 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:25.547296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac933-ddf6-4b84-bc10-9f3d46ab8611 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:25.547398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac933-ddf6-4b84-bc10-9f3d46ab8611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:25.567774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0f9ac933-ddf6-4b84-bc10-9f3d46ab8611 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:25.569056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0f9ac933-ddf6-4b84-bc10-9f3d46ab8611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:25.578031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 735/1483] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:25.614000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726956b-269a-443f-a6d0-7a40fd980dde None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:25.625825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726956b-269a-443f-a6d0-7a40fd980dde None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:25.629466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:25.630166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:25.630418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:25.630705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:25.640429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:25.641867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c941a-f14a-4128-a34c-d7347bf0626e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:25.651655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 749/1484] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:27.744427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7380e-16c6-4b1b-9f12-1223511dd4fd None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:27.745342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7380e-16c6-4b1b-9f12-1223511dd4fd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:27.745342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7380e-16c6-4b1b-9f12-1223511dd4fd None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:27.747597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 736/1485] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:27.754126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6222-0b59-40f9-96ca-14915c186a0e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:27.754789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6222-0b59-40f9-96ca-14915c186a0e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:27.754923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c6222-0b59-40f9-96ca-14915c186a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:27.774498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f83c6222-0b59-40f9-96ca-14915c186a0e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:27.775680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f83c6222-0b59-40f9-96ca-14915c186a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:27.783985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 750/1486] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:27.824467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7380e-16c6-4b1b-9f12-1223511dd4fd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:27.842136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7380e-16c6-4b1b-9f12-1223511dd4fd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:27.846452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:27.847103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:27.847378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:27.847651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:27.857001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:27.858431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7285-1825-492f-ac72-20e681f6c44c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:27.867797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 737/1487] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:29.990571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604642-a3d1-481b-b132-98c2527a5e99 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:29.991073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604642-a3d1-481b-b132-98c2527a5e99 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:29.991073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01604642-a3d1-481b-b132-98c2527a5e99 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:29.992569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 751/1488] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:29.998891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704baa-18bf-4421-8bb6-681b2b75faec None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:29.999613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704baa-18bf-4421-8bb6-681b2b75faec None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:29.999745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9704baa-18bf-4421-8bb6-681b2b75faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:30.022920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d9704baa-18bf-4421-8bb6-681b2b75faec None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:30.024100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d9704baa-18bf-4421-8bb6-681b2b75faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:30.032598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 738/1489] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:30.072534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01604642-a3d1-481b-b132-98c2527a5e99 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:30.084658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01604642-a3d1-481b-b132-98c2527a5e99 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:30.089384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:30.090017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:30.090377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:30.090622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:30.099699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:30.101175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f63d24b-83df-4b58-a725-7aea6f69a015 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:30.110764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 752/1490] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:32.286627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148919a-63d8-4746-b10f-c7493db8bfdd None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:32.287154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148919a-63d8-4746-b10f-c7493db8bfdd None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:32.287154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148919a-63d8-4746-b10f-c7493db8bfdd None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:32.288596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 739/1491] 10.222.0.26 () {54 vars in 926 bytes} [Thu Jul 7 03:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:58:32.294072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1ce6-766f-4df0-b335-d24c42fa3b7e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:32.294521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1ce6-766f-4df0-b335-d24c42fa3b7e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:32.294617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf1ce6-766f-4df0-b335-d24c42fa3b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:32.315422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d3cf1ce6-766f-4df0-b335-d24c42fa3b7e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:58:32.316627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d3cf1ce6-766f-4df0-b335-d24c42fa3b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:58:32.324617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 753/1492] 10.222.0.26 () {58 vars in 1023 bytes} [Thu Jul 7 03:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:58:32.363271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148919a-63d8-4746-b10f-c7493db8bfdd None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:58:32.375485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148919a-63d8-4746-b10f-c7493db8bfdd None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:58:32.379217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:58:32.379891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:58:32.380185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:58:32.380461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:58:32.390095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:58:32.391526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d2a878-b2f0-4505-af42-4bb3558d44b5 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:58:32.402913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 740/1493] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:58:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:58:42.310276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=33 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:58:42.396934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:57.896348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:57.901257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:57.901257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:57.927653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:59:57.928893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:57.938289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 754/1494] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:59:57.946841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:57.947302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:57.947401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:57.967540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:59:57.968783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:57.978281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 741/1495] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 03:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:59:57.983036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:57.993362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe48b9-d290-468d-953d-6f9f59d47e29 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:57.998896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:57.999553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:57.999824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.000091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.000866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 03:59:58.001172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.002324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.002324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 03:59:58.002324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 03:59:58.003211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.015241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 755/1496] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 03:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 03:59:58.023429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.033689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88073c08-405c-4bdc-ad2f-e71777ee08b7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.041808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.042622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.042897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.043185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.044168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.046904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.046904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 03:59:58.046904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 03:59:58.048634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.092685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 742/1497] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 03:59:58 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:59:58.096980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.107623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b37e3-f7b4-4a06-9cb9-c3e3448c863f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.171458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.172154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.172439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.172711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.173411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.174441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.174441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 03:59:58.174441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 03:59:58.175634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.198158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 756/1498] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 03:59:58 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 03:59:58.202532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.213111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a330f56-a4a2-42d8-9dbb-714576e41b33 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.219993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.221281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.221567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.221951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.222674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.223715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.223715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 03:59:58.223715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 03:59:58.224633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.237853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 743/1499] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 03:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:59:58.242105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.252747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069d54-5f5d-4868-84c8-b2949b3add5d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.258525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.259189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.259498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.259764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.260532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.261667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.261667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 03:59:58.261667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 03:59:58.262543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb834336-823a-4c6b-bae1-978b5feb1274 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.275808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 757/1500] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 03:59:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 03:59:58.279974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.290052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee912bb-60a0-439a-a983-ef96bb5555c1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.294738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.295633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.295902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.296198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] PATH_INFO: `/v3/projects/b6581b33eea443a78ba85b1ad835d298/users/f139ea31bf124430b3057b487e93731d/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.311554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6581b33eea443a78ba85b1ad835d298, user_id=f139ea31bf124430b3057b487e93731d, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.312609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.312609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 03:59:58.312609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 03:59:58.314557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a41cc4-e12b-473d-aca6-2850b5e32c65 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.327489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 744/1501] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 03:59:58 2022] PUT /identity/v3/projects/b6581b33eea443a78ba85b1ad835d298/users/f139ea31bf124430b3057b487e93731d/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:59:58.340294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c86-9454-4476-a2bd-54031f8f85b8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.340658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c86-9454-4476-a2bd-54031f8f85b8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.340936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554c86-9454-4476-a2bd-54031f8f85b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.368229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-68554c86-9454-4476-a2bd-54031f8f85b8 None None] MFA Rules not processed for user `f139ea31bf124430b3057b487e93731d`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:59:58.369407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-68554c86-9454-4476-a2bd-54031f8f85b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:58.439806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 758/1502] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 03:59:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:59:58.455681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaba7-1e11-49bf-a587-697421e4b620 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.455965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaba7-1e11-49bf-a587-697421e4b620 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.456331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999eaba7-1e11-49bf-a587-697421e4b620 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.458037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 745/1503] 10.222.0.26 () {54 vars in 963 bytes} [Thu Jul 7 03:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:59:58.463582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a2e8-5175-44ea-9b98-e880adfeb3af None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.463864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a2e8-5175-44ea-9b98-e880adfeb3af None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.464140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a2e8-5175-44ea-9b98-e880adfeb3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.484171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1d56a2e8-5175-44ea-9b98-e880adfeb3af None None] MFA Rules not processed for user `f777aaf6bb714c8c949105aa8556c0bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:59:58.485437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d56a2e8-5175-44ea-9b98-e880adfeb3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:58.529928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:58.539635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 759/1504] 10.222.0.26 () {58 vars in 1060 bytes} [Thu Jul 7 03:59:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:59:58.547440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaba7-1e11-49bf-a587-697421e4b620 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.559446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999eaba7-1e11-49bf-a587-697421e4b620 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.563538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.564246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.564522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.564820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.573807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.575299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.584417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 746/1505] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:59:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:59:58.627790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8f7b-3fc9-4d86-b20e-aec13c84a314 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.628071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8f7b-3fc9-4d86-b20e-aec13c84a314 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.628371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b8f7b-3fc9-4d86-b20e-aec13c84a314 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.629692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 760/1506] 10.222.0.26 () {52 vars in 829 bytes} [Thu Jul 7 03:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 03:59:58.633580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.697449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9e32a-d6df-4e1d-9ce3-1500e7445fe2 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:58.703134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:58.704263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.704724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.705122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] PATH_INFO: `/v3/users/f139ea31bf124430b3057b487e93731d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.707053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f139ea31bf124430b3057b487e93731d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:58.708338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:58.708338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 03:59:58.708338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 03:59:58.709951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:58.790988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f139ea31bf124430b3057b487e93731d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:58.802926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f139ea31bf124430b3057b487e93731d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:58.803743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f139ea31bf124430b3057b487e93731d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:58.804922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f139ea31bf124430b3057b487e93731d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:58.823152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f139ea31bf124430b3057b487e93731d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:58.831936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 03:59:58.843950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 747/1507] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 03:59:58 2022] DELETE /identity/v3/users/f139ea31bf124430b3057b487e93731d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 03:59:58.848492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:58.848836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:58.849111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:58.867337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 03:59:58.868592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:58.930352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 761/1508] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 03:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 03:59:58.940917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:58.943474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:59.014526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb976581-5a2e-41f0-8b33-e1ffaa6b5564 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:59.018562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:59.019206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:59.019483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:59.019763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:59.029264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:59.030692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e4da4-e938-4e7c-97ac-b1658ccdbb3d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:59.040336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 748/1509] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 03:59:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 03:59:59.419387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 03:59:59.420863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 03:59:59.433213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce7b6-27ec-4a50-9344-5335d28d6a19 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 03:59:59.438403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 03:59:59.439214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 03:59:59.439490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 03:59:59.439758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] PATH_INFO: `/v3/projects/b6581b33eea443a78ba85b1ad835d298` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 03:59:59.440974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6581b33eea443a78ba85b1ad835d298)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 03:59:59.442007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 03:59:59.442007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 03:59:59.442007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 03:59:59.443198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 03:59:59.507629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6581b33eea443a78ba85b1ad835d298', 'request_id': 'req-563cc0d0-6e09-4195-8e47-8f153036ac0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:59.522701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6581b33eea443a78ba85b1ad835d298', 'request_id': 'req-563cc0d0-6e09-4195-8e47-8f153036ac0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:59.533834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6581b33eea443a78ba85b1ad835d298', 'request_id': 'req-563cc0d0-6e09-4195-8e47-8f153036ac0f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:59.545391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] The token cache is being invalidate because project b6581b33eea443a78ba85b1ad835d298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 03:59:59.545675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:59.546311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-563cc0d0-6e09-4195-8e47-8f153036ac0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 03:59:59.548037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 762/1510] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 03:59:59 2022] DELETE /identity/v3/projects/b6581b33eea443a78ba85b1ad835d298 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:00:09.036047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=29 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:00:09.542196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:44.465738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:44.466292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:44.466292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:44.467698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 04:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:01:44.473075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e137-96ab-4af2-8b6b-b402d60346d4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:44.473530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e137-96ab-4af2-8b6b-b402d60346d4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:44.473625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569e137-96ab-4af2-8b6b-b402d60346d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:44.493056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2569e137-96ab-4af2-8b6b-b402d60346d4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:44.494259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2569e137-96ab-4af2-8b6b-b402d60346d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:44.559146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 04:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:01:44.724924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:01:44.727962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:44.810745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13526a4-5e5c-4868-8379-2942291ff7a8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:01:44.817174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:01:44.817832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:44.818107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:44.818402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:44.826956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:01:44.828749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e115cdf-be88-43d1-b588-86eca331c36d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:01:44.838770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 750/1513] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:01:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:01:45.661626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337b745-6ae2-48d0-9c8e-2ca74b743c6a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:45.662429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337b745-6ae2-48d0-9c8e-2ca74b743c6a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:45.662562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337b745-6ae2-48d0-9c8e-2ca74b743c6a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:45.664795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 04:01:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:01:45.669835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268918-6a69-4fd2-8acc-facc0214ac1c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:45.670307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268918-6a69-4fd2-8acc-facc0214ac1c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:45.670419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268918-6a69-4fd2-8acc-facc0214ac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:45.690464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-25268918-6a69-4fd2-8acc-facc0214ac1c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:45.691650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-25268918-6a69-4fd2-8acc-facc0214ac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:45.700024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 04:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:01:45.857613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337b745-6ae2-48d0-9c8e-2ca74b743c6a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:01:45.880907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337b745-6ae2-48d0-9c8e-2ca74b743c6a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:01:45.887752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:01:45.888437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:45.888718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:45.888978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:45.898135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:01:45.899769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e44f9d-8bbe-43e3-8fcd-5549337092a1 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:01:45.909718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 765/1516] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:01:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:01:46.366721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041480-32cb-4d4e-b1f8-b3b462ad22ce None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:46.366965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041480-32cb-4d4e-b1f8-b3b462ad22ce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:46.367263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff041480-32cb-4d4e-b1f8-b3b462ad22ce None None] PATH_INFO: `/v3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:46.368633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 752/1517] 10.222.0.18 () {54 vars in 925 bytes} [Thu Jul 7 04:01:46 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:01:46.375735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf929-5724-457b-bb1f-f0946dc00013 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:46.376017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf929-5724-457b-bb1f-f0946dc00013 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:46.376329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bf929-5724-457b-bb1f-f0946dc00013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:46.399917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db4bf929-5724-457b-bb1f-f0946dc00013 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:46.401202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db4bf929-5724-457b-bb1f-f0946dc00013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:46.466851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 766/1518] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jul 7 04:01:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:01:55.653191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8fcc9-cce0-460f-bbc2-48ad57ec5d5e None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:55.653942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8fcc9-cce0-460f-bbc2-48ad57ec5d5e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:55.653942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b8fcc9-cce0-460f-bbc2-48ad57ec5d5e None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:55.656197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 753/1519] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jul 7 04:01:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:01:55.664981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37db4a-4eb0-4ac3-ad53-855aa984af09 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:55.665719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37db4a-4eb0-4ac3-ad53-855aa984af09 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:55.665872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37db4a-4eb0-4ac3-ad53-855aa984af09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:55.684415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=37 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:01:55.687992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0a37db4a-4eb0-4ac3-ad53-855aa984af09 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:55.689217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0a37db4a-4eb0-4ac3-ad53-855aa984af09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:55.699290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 767/1520] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jul 7 04:01:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:01:55.706728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8fcc9-cce0-460f-bbc2-48ad57ec5d5e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:01:55.722988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b8fcc9-cce0-460f-bbc2-48ad57ec5d5e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:01:55.728293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:01:55.728931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:55.729227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:55.729495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:55.738058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:01:55.739647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd0056-0f77-4942-acce-2ea699852caf service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:01:55.749353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 754/1521] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:01:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:01:57.143399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290ac9-193c-4aab-a415-4582ac0f839d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:57.143983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290ac9-193c-4aab-a415-4582ac0f839d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:57.143983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290ac9-193c-4aab-a415-4582ac0f839d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:57.145472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 04:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:01:57.154823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75003-c41c-4d07-864e-6550c5d01fb1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:57.155662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75003-c41c-4d07-864e-6550c5d01fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:57.155662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c75003-c41c-4d07-864e-6550c5d01fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:57.181282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-96c75003-c41c-4d07-864e-6550c5d01fb1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:57.182503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96c75003-c41c-4d07-864e-6550c5d01fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:57.191140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 04:01:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:01:57.354004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f290ac9-193c-4aab-a415-4582ac0f839d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:01:57.371173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f290ac9-193c-4aab-a415-4582ac0f839d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:01:57.376665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:01:57.377301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:57.377573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:57.377837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:57.386419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:01:57.388045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5158859b-7954-4638-9ccc-9589065c33b8 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:01:57.398361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 769/1524] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:01:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:01:58.202204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a589-c0c1-4337-8561-3f87870f9d21 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:58.203038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a589-c0c1-4337-8561-3f87870f9d21 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:58.203038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a589-c0c1-4337-8561-3f87870f9d21 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:58.204782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 7 04:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:01:58.209894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933850f3-3982-44b3-8f73-e030e535630b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:58.210300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933850f3-3982-44b3-8f73-e030e535630b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:58.210488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933850f3-3982-44b3-8f73-e030e535630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:58.231268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-933850f3-3982-44b3-8f73-e030e535630b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:01:58.232548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-933850f3-3982-44b3-8f73-e030e535630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:01:58.240994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 7 04:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:01:58.393762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a589-c0c1-4337-8561-3f87870f9d21 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:01:58.415401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a589-c0c1-4337-8561-3f87870f9d21 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:01:58.421801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:01:58.422466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:01:58.422723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:01:58.422997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:01:58.431373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:01:58.433005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8feb63f-53e8-488f-a66c-a519cd6ab136 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:01:58.442640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 757/1527] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:02:02.307141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:02.307714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:02.307714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:02.309222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 04:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:02:02.314783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208355e-c2ff-494f-93ba-080ab9192ca5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:02.315217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208355e-c2ff-494f-93ba-080ab9192ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:02.315319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208355e-c2ff-494f-93ba-080ab9192ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:02.337621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4208355e-c2ff-494f-93ba-080ab9192ca5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:02:02.338800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4208355e-c2ff-494f-93ba-080ab9192ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:02.347658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 04:02:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:02:02.418934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:02:02.421109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:02.490762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526efbb4-b5c1-4676-8e06-88abfb4f9841 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:02:02.494841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:02:02.495486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:02.495755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:02.496005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:02.505957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:02:02.507405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae174fc-6da4-451a-a9ed-dc04479eb92f service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:02:02.512390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:02.517453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 772/1530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:02:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:02:04.528732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:04.529697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:04.529697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:04.531863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 04:02:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:02:04.538073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126fa5-5b39-474a-b5fc-08ee2822cef5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:04.538518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126fa5-5b39-474a-b5fc-08ee2822cef5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:04.538622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3126fa5-5b39-474a-b5fc-08ee2822cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:04.565121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e3126fa5-5b39-474a-b5fc-08ee2822cef5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:02:04.566333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e3126fa5-5b39-474a-b5fc-08ee2822cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:04.575155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 04:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:02:04.615166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:02:04.618396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:04.635933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415f06e-350a-40c4-9966-38a0e6b51619 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:02:04.640579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:02:04.641277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:04.641549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:04.641832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:04.651509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:02:04.652976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027ef6e2-d5aa-40e7-b6d2-41c4a88b43cb service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:02:04.662761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 760/1533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:02:08.127531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:08.128091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:08.128091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:08.130239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 04:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:02:08.138750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c77e-b484-42a7-898e-ed5176348c39 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:08.139424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c77e-b484-42a7-898e-ed5176348c39 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:08.139529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4c77e-b484-42a7-898e-ed5176348c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:08.165831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-21a4c77e-b484-42a7-898e-ed5176348c39 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:02:08.167047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-21a4c77e-b484-42a7-898e-ed5176348c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:08.176148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 04:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:02:08.481567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:02:08.484978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:08.547057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513caf7-0f87-49ac-8f6b-336ad527dbcc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:02:08.551032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:02:08.551681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:08.551959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:08.552270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:08.562419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:02:08.563900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafa44e-8c3d-4dfb-bc65-d65002f53a89 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:02:08.574048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 775/1536] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:02:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:02:10.609546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:10.610179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:10.610179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:10.611542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 7 04:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:02:10.616938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865ec8-c9d3-48d2-a5f0-470866a01417 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:10.617382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865ec8-c9d3-48d2-a5f0-470866a01417 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:10.617490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74865ec8-c9d3-48d2-a5f0-470866a01417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:10.636917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-74865ec8-c9d3-48d2-a5f0-470866a01417 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:02:10.638124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-74865ec8-c9d3-48d2-a5f0-470866a01417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:10.646391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 7 04:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:02:10.945331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:02:10.948697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:02:10.965805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103db6a7-f34c-49ce-92ef-4e6160d37760 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:02:10.970285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:02:10.970951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:02:10.971230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:02:10.971499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:02:10.980677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:02:10.982107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d8235-30a6-4ccf-a96b-83162e933dac service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:02:10.991643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 763/1539] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:02:20.631757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=32 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:02:20.987323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=33 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:54.338285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.339442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.339933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.365149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:54.366916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:54.376304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 777/1540] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:03:54.385992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf2e7-d001-46c3-812a-a1a219d2a051 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.387187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf2e7-d001-46c3-812a-a1a219d2a051 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.387691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf2e7-d001-46c3-812a-a1a219d2a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.416314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f28bf2e7-d001-46c3-812a-a1a219d2a051 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:54.418056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f28bf2e7-d001-46c3-812a-a1a219d2a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:54.426857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 764/1541] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:03:54.432514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.443990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cd657-1604-43b1-bb22-62d5c7c4ca77 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.452964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.453690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.453974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.454397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.455213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:54.455521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.461607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:54.475553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61711d3-9d9a-4024-b91a-d2ab6917b656 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.476316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61711d3-9d9a-4024-b91a-d2ab6917b656 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.476824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61711d3-9d9a-4024-b91a-d2ab6917b656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.483541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 778/1542] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:54.511161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a61711d3-9d9a-4024-b91a-d2ab6917b656 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:54.511404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.512943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a61711d3-9d9a-4024-b91a-d2ab6917b656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:54.527848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544ad50-ec4b-44d3-9bbf-3261c1fd35e7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.535030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 765/1543] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:54.537649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.538357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.538638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.538915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.539654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.540770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:03:54.540770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 04:03:54.540770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 04:03:54.542011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:54.546704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.547288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.547792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.581470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:54.583106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:54.602496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 766/1544] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:03:54.607854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.610035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 779/1545] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:54.627241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73798d7c-3396-45d4-920a-4d777e8eb0c2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.632149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.720839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.721959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.722451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.722944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.723888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:54.727652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.728984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:03:54.728984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 04:03:54.728984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 04:03:54.730252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:54.743645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 767/1546] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:03:54.752335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.763461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff79b-dc81-4c7a-9309-3e0572b48a19 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.776221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.777213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.777712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.778410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.779344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.781537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:54.807739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ebdf7-f413-475a-89c0-171274405ae8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.820885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.821541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.821882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.822456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.823053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.832697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:54.834709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 768/1547] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:54.839253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.874386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 780/1548] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:54.879900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:54.902479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0de16c-bb0c-4e9b-9a02-12fc48b60aa7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.977556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536287c3-5452-416b-8676-0ad39a91d55b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:54.988504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:54.990091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:54.990369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:54.990695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:54.991473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:54.993199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:03:54.993199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 04:03:54.993199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 04:03:55.001141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572bf120-ad02-482c-a311-3a771e063b73 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.038087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 769/1549] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:54 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:03:55.039531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4a3e-84ed-4a3f-9bf6-5998cf55b25d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.039821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4a3e-84ed-4a3f-9bf6-5998cf55b25d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.040093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e4a3e-84ed-4a3f-9bf6-5998cf55b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.060174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.060174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.060174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.060174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.060676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.061667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc7b41a-5d9d-4dd2-9b91-6ed84c717605 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.065636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9a3e4a3e-84ed-4a3f-9bf6-5998cf55b25d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.066867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a3e4a3e-84ed-4a3f-9bf6-5998cf55b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.073159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 781/1550] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:03:55.074360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d695f7-ce35-48e5-a88e-67029a072e6c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.074776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d695f7-ce35-48e5-a88e-67029a072e6c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.075052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d695f7-ce35-48e5-a88e-67029a072e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.080180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 770/1551] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.080180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.080180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.080489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.099543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-92d695f7-ce35-48e5-a88e-67029a072e6c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.100830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-92d695f7-ce35-48e5-a88e-67029a072e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.102494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.103670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.108683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 782/1552] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.109901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dfd29-1187-49e0-8a9e-fac9ce9ed179 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.110176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dfd29-1187-49e0-8a9e-fac9ce9ed179 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.110445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dfd29-1187-49e0-8a9e-fac9ce9ed179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.111676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 771/1553] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.112488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.125146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b814-7e96-41a4-bbd8-d587ad7992ab None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.130323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.131004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.131346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.131562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df7dfd29-1187-49e0-8a9e-fac9ce9ed179 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.131699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.132409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.132782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df7dfd29-1187-49e0-8a9e-fac9ce9ed179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.134138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.140679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 783/1554] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.141911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c186-4a0a-4861-8b41-d6b564f1369f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.142192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c186-4a0a-4861-8b41-d6b564f1369f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.142467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93c186-4a0a-4861-8b41-d6b564f1369f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.145033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 772/1555] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:55.145638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.158587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ced4d-a145-4418-b95c-aff8a5b7ddb9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.162550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9a93c186-4a0a-4861-8b41-d6b564f1369f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.163798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9a93c186-4a0a-4861-8b41-d6b564f1369f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.163989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.164695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.164976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.166025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.166783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.168410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab77d2-8d83-445b-87e1-b3889ce54806 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.173123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 784/1556] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.180602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf64b4-31c1-4f07-9aa3-6f9e82fb5e78 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.180602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf64b4-31c1-4f07-9aa3-6f9e82fb5e78 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.180602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cf64b4-31c1-4f07-9aa3-6f9e82fb5e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.180870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 773/1557] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:55.181470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c28c6-b242-49b2-935d-7bf7a7f9df47 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.181793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c28c6-b242-49b2-935d-7bf7a7f9df47 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.182118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c28c6-b242-49b2-935d-7bf7a7f9df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.194789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.195927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e5cf64b4-31c1-4f07-9aa3-6f9e82fb5e78 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.197422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e5cf64b4-31c1-4f07-9aa3-6f9e82fb5e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.200703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-321c28c6-b242-49b2-935d-7bf7a7f9df47 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.202230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-321c28c6-b242-49b2-935d-7bf7a7f9df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.205405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 785/1558] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.206636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653119-f953-47fb-bd8c-9d64e8cfb946 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.206914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653119-f953-47fb-bd8c-9d64e8cfb946 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.207191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25653119-f953-47fb-bd8c-9d64e8cfb946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.210872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 774/1559] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.212180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.212524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.212805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.226375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-25653119-f953-47fb-bd8c-9d64e8cfb946 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.227571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-25653119-f953-47fb-bd8c-9d64e8cfb946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.230903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.232059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.235444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 786/1560] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.236652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186ad75-2d04-400d-93cc-06114ea5babb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.236935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186ad75-2d04-400d-93cc-06114ea5babb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.237208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186ad75-2d04-400d-93cc-06114ea5babb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.243296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 775/1561] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.244075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.253347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95fc5-07b8-4e9c-83ea-4ef99ec3cae3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.255985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4186ad75-2d04-400d-93cc-06114ea5babb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.257235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4186ad75-2d04-400d-93cc-06114ea5babb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.257864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.258520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.258874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.259144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.259977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.261777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.265147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 787/1562] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.266373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.266655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.266931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.274198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 776/1563] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:55.274514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.274993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.285230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c17ec6-970e-4aa9-9a20-00590e3c7c85 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.289691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.289835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.290583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.290857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.290970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.291124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] PATH_INFO: `/v3/projects/ec5ed999a41349d599d638e354a9702f/users/029553978cc8405294ccb302665edbe2/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.298740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 788/1564] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.300732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.306252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec5ed999a41349d599d638e354a9702f, user_id=029553978cc8405294ccb302665edbe2, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.308932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b1dd9e-a41f-4d74-b20d-b629ef239433 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.310577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d90b47-eadb-45d2-8d9e-cee9c6211bf6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.316300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.316960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.317234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.317499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.318228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.318786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.320216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.323212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 777/1565] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:55 2022] PUT /identity/v3/projects/ec5ed999a41349d599d638e354a9702f/users/029553978cc8405294ccb302665edbe2/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:55.324614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.324995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.325366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.333020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 789/1566] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.333906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.345035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.345565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7322a-94d5-4fcc-a504-ed4a9380efc4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.346250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.402422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.403023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.403295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.403579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.405544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.405863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.407972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.410668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 778/1567] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.411663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.422293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218b1674-911b-436c-b7d3-2ddf63cf12ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.432075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 790/1568] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.432075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.432367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.432367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.432367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.432367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.432770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.432770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.434268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.435888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963b07a2-cc1e-4667-83fe-f6906ca23ada admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.441091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.442250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.442526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.442793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.444215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.444645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.446272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.446796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 779/1569] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.448313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.458260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56d788-d2af-406e-ac3e-351567ae0ee0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.460293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 791/1570] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.461122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.463246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.464346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.464756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.465033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] PATH_INFO: `/v3/projects/e454a886d2414bca8129497695e28e41/users/c9981634365c4857b20ba59e7ece9f74/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.472553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af4211-f094-493b-911f-feff3ce45ac2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.479489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.480310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.480592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.480888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e454a886d2414bca8129497695e28e41, user_id=c9981634365c4857b20ba59e7ece9f74, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.480993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.481622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.481932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.483549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dc87-8b88-4a1e-a06a-5a7ac8883976 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.483682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.495771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 792/1571] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.497274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 780/1572] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:55 2022] PUT /identity/v3/projects/e454a886d2414bca8129497695e28e41/users/c9981634365c4857b20ba59e7ece9f74/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:55.497406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.497406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.497614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.497861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.519811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.521125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.572366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc09a6-6cae-4e11-af6e-86f8d58cdf32 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.576893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.577294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 793/1573] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.577561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.577844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.578110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.578241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.578810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.581296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.589235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c7c8-db20-45df-8df3-0dc8b8767f6e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.593785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.594444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.594725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.594992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.595721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:03:55.596023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.597804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.607882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 781/1574] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:55.607882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.613197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 794/1575] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:03:55.614134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.623595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdc06a-97bb-4465-a2b8-820cdd0b08ee admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.624055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.662752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.677476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac0001-e363-4fd7-a784-5577ae426095 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.682189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.682347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.682862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.683012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.683141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.683289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.683413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.683560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.684098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.684282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.686047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.686164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.720021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 782/1576] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:55.720021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.720433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 795/1577] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:55.720433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.779327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792b2b-cffb-40de-a75e-e6f502056a0c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.780689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee2f8a-b8f8-49a6-91c4-0343493c224f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.783921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.785241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.785601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.785886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.786140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.786274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.786594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.786835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.787060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.787909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.789532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb7f978-af1a-4bfa-a23a-c1f55e0b4461 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.790021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.815901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 796/1578] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:55.822060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 783/1579] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:55.822242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.822242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.822242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.822480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.845541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] MFA Rules not processed for user `c9981634365c4857b20ba59e7ece9f74`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:55.846781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:55.876064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0beb51d-48b0-4b18-9ad9-2d9d886a6de9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.880229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.880896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.881249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.881642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.910668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 797/1580] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:55.911497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.912025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.950601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.952130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.962983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 784/1581] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:55.963277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:55.963556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:55.972941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9799e-c2b2-4459-aa45-bec25c1ef1d0 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.978496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.979057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.979413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.979607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.980360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:55.982291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:55.989054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70599c-50b1-44ff-9203-157249aa13ab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:55.995276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:55.995966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:55.996278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:55.996553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:55.997518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.000374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.016707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 785/1582] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.016707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.026715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 798/1583] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:55 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.027786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.040167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b526d-8a7c-49b7-bc8f-a6761e64005b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.092779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4962894-e9da-4bb1-b367-e5b3287c6dd8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.099469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.100315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.100664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.101000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.101775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.104303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.127020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.127545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.127834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.128137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.128987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.131261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.132363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 786/1584] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.133232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.144256 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2512e16-d3e7-4552-b710-91b2423a632b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.150220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.150998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.151339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.151502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.152314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.154336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2194a-9a2d-4835-b7e6-cca91f27854e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.161212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 799/1585] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/users => generated 293 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.162494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.174047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3061b2-59af-4d8c-a684-e6ee8282a710 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.179354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.180191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.180692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.181199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.182376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.186789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 787/1586] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.186789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7891e-04fe-4309-9d29-9a9df4602cf4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.187056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.187145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7891e-04fe-4309-9d29-9a9df4602cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.187145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7891e-04fe-4309-9d29-9a9df4602cf4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.188790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 788/1587] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jul 7 04:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:03:56.193213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7891e-04fe-4309-9d29-9a9df4602cf4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.207321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7891e-04fe-4309-9d29-9a9df4602cf4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.209063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 800/1588] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.212327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.215048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.215759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.216033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.216354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.217050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.218957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.221981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae2ae75-47f2-4b66-9cd8-26ba8a210297 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.227213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.227872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.228169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.228447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.229274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.230880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.241923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 789/1589] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:56.243099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.248589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 801/1590] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.250003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.254427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9f2f5-1ed3-4903-805c-88651c578b47 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.264385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.266132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.266752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.268518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.269476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.269991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc60fc-d1ff-42af-ae05-b5bdc1f21f01 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.271401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.276110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.277090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.277534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.278005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.279351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.281836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2293842-947a-4581-8b78-d9a5763bad53 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.285612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 790/1591] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.286798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.294861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 802/1592] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.296321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.296610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.296898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.306776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a43f33-2f8d-44e1-b75a-609f51b654c6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.314622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.315371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.315654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.315932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.316814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.318489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.327457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:56.328983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:56.331012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 791/1593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.331755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.345421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1ac77-0fa2-484d-a117-b0f5049510f7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.351385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.352370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.352802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.353261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.354149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.356068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.371697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 792/1594] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.371697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.383368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa3430-3b7b-4ada-8231-281bd375a5a7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.389357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.390252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.391017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.391949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.392096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.393873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.405935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 793/1595] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.406623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.419701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e56ada-6a0b-4e8e-9fb1-f51299508f05 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.423445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 803/1596] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:56.424510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.425269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.425401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.425586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.425870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.426615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.428317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.438494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616ff11-92fb-40c5-851e-58421ddbcc6b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.439575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 794/1597] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.442985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.446370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.447012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.447289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.447558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.447781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:56.448720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.450497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.452385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9078e9-89e5-425d-87cb-ea2d528eabe5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.458620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:56.462305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.463124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.463422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.463748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.464658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.468848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.469665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 804/1598] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.471233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.483389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 795/1599] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.484305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.486090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ff483-61ef-4d1f-9d5a-5264ff7bef22 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.491683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.493062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.493062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.493062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.493745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.495529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.497434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a79ee-b3c8-4bc9-8c4b-fdb3373c88be admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.502859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.503702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.504044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.504410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.505220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.507022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.511043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 805/1600] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.511043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.519014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a53921-9105-4f07-91ac-0cb00bf3fd45 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.524744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 796/1601] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.524744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.526876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.527917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.528220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.528494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.529642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.530996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.537526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8cb1c-ff12-411b-8a95-be40b20af100 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.544165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 806/1602] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:56.544165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.545882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.547266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.547668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.548081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.561921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20459d-ff46-4c60-9873-6818a204b63f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.573649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.574569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.574844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.575111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] PATH_INFO: `/v3/projects/e09a7d203d614ea587dcbea88776b310/users/aa55b383fe014d648c466919e16ffb7f/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.591830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09a7d203d614ea587dcbea88776b310, user_id=aa55b383fe014d648c466919e16ffb7f, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.592921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:03:56.592921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 04:03:56.592921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 04:03:56.594904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.611381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.613148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.613763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 807/1603] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/e09a7d203d614ea587dcbea88776b310/users/aa55b383fe014d648c466919e16ffb7f/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:56.618010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.623705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 797/1604] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:56.624660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.635346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a9d18-174b-4e56-8a74-622ba7abd8c0 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.688758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5284674-a80d-47fb-b488-05c7af8dcf3d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.694043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.695026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.695373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.695714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] PATH_INFO: `/v3/projects/47cf676545744501bdc403ce39dc9b5b/users/82a27d0525d942d99b3c5b19971208dc/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.717654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cf676545744501bdc403ce39dc9b5b, user_id=82a27d0525d942d99b3c5b19971208dc, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.720863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.722227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.723063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.723496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.723877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] PATH_INFO: `/v3/projects/f845e08d872246e7941be676801f7722/users/ca817816906a46a9a2423dc427fa3cee/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.738384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 808/1605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/47cf676545744501bdc403ce39dc9b5b/users/82a27d0525d942d99b3c5b19971208dc/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:56.739461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.758886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f845e08d872246e7941be676801f7722, user_id=ca817816906a46a9a2423dc427fa3cee, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.761680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.790069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 798/1606] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/f845e08d872246e7941be676801f7722/users/ca817816906a46a9a2423dc427fa3cee/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:56.791055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.873136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b37d03-44e6-4a3f-9606-894e2dc3444f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.879995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.880210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff760ec-3d08-4ac6-b7ca-66b1dab0b5cc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:56.881120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.881502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.881817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] PATH_INFO: `/v3/projects/c7c3511b8e4f4f0e99f3d9af3ec7bb1d/users/09468c9954cf40f8aa0b29bffa8240b1/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.885728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:56.886573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.887152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.887936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] PATH_INFO: `/v3/projects/dbc19ceca20143fe9b2989336a7c755e/users/26ce1c1b87eb441bb883c639c92339d5/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.897640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:56.899452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7c3511b8e4f4f0e99f3d9af3ec7bb1d, user_id=09468c9954cf40f8aa0b29bffa8240b1, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.904196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.906250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbc19ceca20143fe9b2989336a7c755e, user_id=26ce1c1b87eb441bb883c639c92339d5, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:56.910395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db226acc-d608-4f0e-ad9c-f86752e15b2d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:56.933729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 809/1607] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/c7c3511b8e4f4f0e99f3d9af3ec7bb1d/users/09468c9954cf40f8aa0b29bffa8240b1/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:56.935089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:56.940770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 799/1608] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/dbc19ceca20143fe9b2989336a7c755e/users/26ce1c1b87eb441bb883c639c92339d5/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:56.942604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7b0f-e959-4ed0-a89c-42cf2e930cf6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:56.943856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7b0f-e959-4ed0-a89c-42cf2e930cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:56.944300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf7b0f-e959-4ed0-a89c-42cf2e930cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:56.965265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1bcf7b0f-e959-4ed0-a89c-42cf2e930cf6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:56.966673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1bcf7b0f-e959-4ed0-a89c-42cf2e930cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:56.978065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:57.031613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d24835c-9efe-48a1-9b48-85f4b01dd169 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.042548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 800/1609] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.044017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fae04-b7a9-419d-a2f7-270dd9e56509 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.044409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fae04-b7a9-419d-a2f7-270dd9e56509 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.044745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fae04-b7a9-419d-a2f7-270dd9e56509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.067207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e12fae04-b7a9-419d-a2f7-270dd9e56509 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.068750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e12fae04-b7a9-419d-a2f7-270dd9e56509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.077451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 801/1610] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.079044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c0b-fed9-496b-b054-a91702dfa97a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.079429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c0b-fed9-496b-b054-a91702dfa97a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.079817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e30c0b-fed9-496b-b054-a91702dfa97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.099015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-80e30c0b-fed9-496b-b054-a91702dfa97a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.100479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80e30c0b-fed9-496b-b054-a91702dfa97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.109512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 802/1611] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.114119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c07c-2d70-4b9f-8995-bf64f9fcd1bb None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.114504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c07c-2d70-4b9f-8995-bf64f9fcd1bb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.114876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586c07c-2d70-4b9f-8995-bf64f9fcd1bb None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.116444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 803/1612] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jul 7 04:03:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:03:57.117784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939796-16dd-408a-990c-c46e180b5d3d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.118162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939796-16dd-408a-990c-c46e180b5d3d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.118614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb939796-16dd-408a-990c-c46e180b5d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.120740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.121950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.122228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.122551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] PATH_INFO: `/v3/projects/27cb2a2d5cca49228dd2bd42b15007d7/users/f4f87abcddac45ffac8518a7d345fb2c/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.140500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fb939796-16dd-408a-990c-c46e180b5d3d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.141969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fb939796-16dd-408a-990c-c46e180b5d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.142671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cb2a2d5cca49228dd2bd42b15007d7, user_id=f4f87abcddac45ffac8518a7d345fb2c, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.145727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.151991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 804/1613] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.157228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.157610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.157987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.175333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 810/1614] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:56 2022] PUT /identity/v3/projects/27cb2a2d5cca49228dd2bd42b15007d7/users/f4f87abcddac45ffac8518a7d345fb2c/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:57.176332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.201329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] MFA Rules not processed for user `09468c9954cf40f8aa0b29bffa8240b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.202773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.244455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30efa12-dfca-4454-91e3-851b56724bfc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.248497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.249724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.250178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.250590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.303156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 805/1615] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.304322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.314141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8554c-6b20-42fa-b1ca-dc29879fceb8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.319328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.321139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.321596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.322624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.341706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.343699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.350929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:57.359215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 811/1616] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.360545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.374542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64c6ca-9a12-4d26-bc03-8ecc1f727dcc service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.379739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.380968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.381882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.382546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.397319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.400327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1976ba2-40fe-496e-bc2f-7aa315e52fab service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.407879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:57.417116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 812/1617] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.418678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85c26-885b-41a5-8435-ed8fef0123cb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.419036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85c26-885b-41a5-8435-ed8fef0123cb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.419317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c85c26-885b-41a5-8435-ed8fef0123cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.426631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.428331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.440808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 806/1618] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.442006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.445346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-10c85c26-885b-41a5-8435-ed8fef0123cb None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.447351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10c85c26-885b-41a5-8435-ed8fef0123cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.451059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36d63-11a0-4e10-8c60-a10299fbd05b service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.456432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.457214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.457561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.457979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.470024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.471726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adbc0f-09e1-4493-adb0-75eca0323fcd service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.484234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 807/1619] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.488167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.488167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.488167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.525135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] MFA Rules not processed for user `f4f87abcddac45ffac8518a7d345fb2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.528008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.555363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 813/1620] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.558033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ab14-c478-4fe5-80a7-c3557c39c328 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.558323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ab14-c478-4fe5-80a7-c3557c39c328 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.558597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14ab14-c478-4fe5-80a7-c3557c39c328 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.560918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 814/1621] 10.222.0.26 () {54 vars in 961 bytes} [Thu Jul 7 04:03:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:03:57.573459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.573899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.574273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.604705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:57.606012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:57.621850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 815/1622] 10.222.0.26 () {58 vars in 1058 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:03:57.623138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.653926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 808/1623] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:57.655029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.671226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac20e8-1b61-4be0-8615-ccb28ae6c10e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.681070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.681945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.682226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.682502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.694235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.697071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.710856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 809/1624] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.712347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.727117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e18b648-9edd-4dac-ae0f-656b7ac532aa service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.733288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.734191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.734663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.735080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.735590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653f6b0-b567-4f29-a355-d51459a45d47 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.736143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.738680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.746357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.747104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.747391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.747728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.771718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.777137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.783102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 810/1625] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:57.784072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.808383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 816/1626] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:57.895574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b39bc-55d6-4e82-b787-a0dae71a071c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.901346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.902175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.902559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.903718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.905188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.907017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:57.959188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 811/1627] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:03:57 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:03:57.964930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:57.980683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405cebef-3cd7-4683-8cb7-b5711d55d0ac service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:57.987410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:57.988547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:57.989128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:57.990377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:57.991652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:57.993890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13be5a-be79-4c72-9d4a-6526146086e4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:58.017157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 817/1628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:03:58.022220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:58.042084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2f81e-81b4-4b92-b651-17191ab158cc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:58.059211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:58.060639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.062487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.063664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] PATH_INFO: `/v3/projects/63cf464a54094dbab08bc004f45dc491/users/3d0a357266754f58827e63d13eb4231a/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.084765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543623ff-ecdf-4391-97dc-7521dca4e5c0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.085570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543623ff-ecdf-4391-97dc-7521dca4e5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.085956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543623ff-ecdf-4391-97dc-7521dca4e5c0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.087785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 818/1629] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jul 7 04:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 04:03:58.089531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cf464a54094dbab08bc004f45dc491, user_id=3d0a357266754f58827e63d13eb4231a, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:58.093543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:58.098593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.098998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.099374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.113728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:58.125661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 812/1630] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:58 2022] PUT /identity/v3/projects/63cf464a54094dbab08bc004f45dc491/users/3d0a357266754f58827e63d13eb4231a/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:03:58.130678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:58.133269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:58.136766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:58.219040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:03:58.348947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 819/1631] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:03:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:03:58.348947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:58.387809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda16bd3-e428-4ade-bb5f-5ef5c547087f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:58.399333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:58.400307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.401266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.401266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.403297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:58.405138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:58.411873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6300e56-4109-4f7c-ae31-d293ded51295 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:58.420985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:58.421702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.421982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.422263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.429434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 813/1632] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:03:58.434627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:58.448301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b830-0105-47d4-9121-76e8e449b330 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:58.457248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:58.457733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:58.459123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.460493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.461052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] PATH_INFO: `/v3/projects/63cf464a54094dbab08bc004f45dc491/users/3d0a357266754f58827e63d13eb4231a/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.462747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:58.464595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cf464a54094dbab08bc004f45dc491, user_id=3d0a357266754f58827e63d13eb4231a, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:58.472716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaedf4-9606-43e2-9743-69b017b2b136 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:58.497604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 814/1633] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:03:58 2022] PUT /identity/v3/projects/63cf464a54094dbab08bc004f45dc491/users/3d0a357266754f58827e63d13eb4231a/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:03:58.512427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 820/1634] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:58.520252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:58.520884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:58.521253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:58.599923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] MFA Rules not processed for user `3d0a357266754f58827e63d13eb4231a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:03:58.601620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:03:58.738510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 815/1635] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:03:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:03:58.898094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:58.909723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d124a8c-19c7-4022-87eb-1c80b15e73df service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:59.044862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:59.045953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:59.046414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:59.046797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:59.070742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:59.075175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:59.112816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 821/1636] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:03:59.431845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:03:59.450665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a5ffe-4d08-441d-a3ae-3705ca1011d9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:03:59.463820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:03:59.464643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:03:59.464986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:03:59.465349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:03:59.594259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:03:59.596341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec399859-7059-401b-bf48-fe126d5b9bbd service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:03:59.611125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 816/1637] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:03:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:02.194986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:02.323906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5452cd3f-f2f1-4f73-a99a-dd5bccb16afe service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:02.332019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:02.333629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:02.333877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:02.334199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] PATH_INFO: `/v3/users/09468c9954cf40f8aa0b29bffa8240b1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:02.336421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09468c9954cf40f8aa0b29bffa8240b1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:02.337979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:04:02.337979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 07 04:04:02.337979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: Jul 07 04:04:02.339528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:02.696774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:02.711268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09468c9954cf40f8aa0b29bffa8240b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:02.738030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09468c9954cf40f8aa0b29bffa8240b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:02.813888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09468c9954cf40f8aa0b29bffa8240b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:02.822694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09468c9954cf40f8aa0b29bffa8240b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:02.826604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09468c9954cf40f8aa0b29bffa8240b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:02.892227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 822/1638] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:02 2022] DELETE /identity/v3/users/09468c9954cf40f8aa0b29bffa8240b1 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:02.898527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80a90-7818-4e51-8b40-5b26b0b7c95a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:02.899083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80a90-7818-4e51-8b40-5b26b0b7c95a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:02.900316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc80a90-7818-4e51-8b40-5b26b0b7c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:02.911997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:02.934704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0fc80a90-7818-4e51-8b40-5b26b0b7c95a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:02.935963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0fc80a90-7818-4e51-8b40-5b26b0b7c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:03.069524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 817/1639] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:03.121114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:03.122755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:03.244066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1434-a1bf-4a5b-9ec1-00634e005a40 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:03.249602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:03.250391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:03.250788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:03.251149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:03.272140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:03.274882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:03.288696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 823/1640] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:04.160927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:04.161828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:04.162341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:04.208775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:04.210882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.252104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] MFA Rules not processed for user `029553978cc8405294ccb302665edbe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:04.255746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.256458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32241399-b887-4866-80c1-a05f3441a075 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:04.285353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:04.288523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:04.291103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:04.292569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] PATH_INFO: `/v3/projects/c7c3511b8e4f4f0e99f3d9af3ec7bb1d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:04.299362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7c3511b8e4f4f0e99f3d9af3ec7bb1d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:04.305883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:04.470235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7c3511b8e4f4f0e99f3d9af3ec7bb1d', 'request_id': 'req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:04.490862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7c3511b8e4f4f0e99f3d9af3ec7bb1d', 'request_id': 'req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:04.511389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7c3511b8e4f4f0e99f3d9af3ec7bb1d', 'request_id': 'req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:04.513219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 818/1641] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:04.527773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:04.530021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.545226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] The token cache is being invalidate because project c7c3511b8e4f4f0e99f3d9af3ec7bb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:04.545519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:04.551777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b0fd25ba-7220-4587-9fd2-14f26b2ca7d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:04.559039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 824/1642] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:04 2022] DELETE /identity/v3/projects/c7c3511b8e4f4f0e99f3d9af3ec7bb1d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:04.561540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15b1f-090d-4c68-85e1-e76e41c07962 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:04.561830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15b1f-090d-4c68-85e1-e76e41c07962 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:04.562109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb15b1f-090d-4c68-85e1-e76e41c07962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:04.619739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4bb15b1f-090d-4c68-85e1-e76e41c07962 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:04.621852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4bb15b1f-090d-4c68-85e1-e76e41c07962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.700434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b223e-0a98-4717-9348-66e90e3c6b6d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:04.747804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:04.777366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:04.787303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 825/1643] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:04.795680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:04.796054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:04.796440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:04.853363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:04.857646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:04.858011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:04.861214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:04.870462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.872348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:04.873529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:04.902812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 826/1644] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:04.916385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:04.990836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d6f39d-91ba-43be-96b9-6b4e059dd3ba None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.002226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.002939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.003202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.003469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.004293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:05.014294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.015836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.046079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 827/1645] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:05.048166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.063190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61d5a-9b30-4c69-8c00-64452fa03d52 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.078417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.079387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.081178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.081837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.082913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.083872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.088248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.088967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.124392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 819/1646] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:05.182773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 828/1647] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:05 2022] POST /identity/v3/projects => generated 403 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:05.186989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.199259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07328e0a-b787-4bcb-944f-31fb8a676e10 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.306616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.307341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.307623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.307941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.308805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.310906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.348290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 820/1648] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:05 2022] POST /identity/v3/users => generated 302 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:05.350072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.369488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523684a-e9eb-41ea-bbd4-5fa6022f90f6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.383806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.385044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.387505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.387975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.392546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.394999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.421131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 829/1649] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:05.425119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.457010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c0a03-98a7-4734-aa8e-1aa6f37fbd24 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.479728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.492930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.495758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.497164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.501464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.508085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.546878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 821/1650] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:05.554035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.559918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.562313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:05.575701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc230273-69ac-4553-a50d-f9710b849ec9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.580227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7328d9-a495-4703-a481-8994a76ca745 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:05.587450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.589875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.590118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.590396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] PATH_INFO: `/v3/projects/9d5f86f5bc6045d5b29ecc1ac9dbd121/users/0c1fd9d19f7143f8ba2288f4af40ed81/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.591238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:05.594793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.595380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.596032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] PATH_INFO: `/v3/users/c9981634365c4857b20ba59e7ece9f74` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.598089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9981634365c4857b20ba59e7ece9f74)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.603872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.635939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d5f86f5bc6045d5b29ecc1ac9dbd121, user_id=0c1fd9d19f7143f8ba2288f4af40ed81, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:05.643246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94376ba-a84a-4cf4-8321-362c25352f5f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:05.671898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 830/1651] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:05 2022] PUT /identity/v3/projects/9d5f86f5bc6045d5b29ecc1ac9dbd121/users/0c1fd9d19f7143f8ba2288f4af40ed81/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:05.676935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.677517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.678019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.684404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:05.690668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9981634365c4857b20ba59e7ece9f74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:05.708410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9981634365c4857b20ba59e7ece9f74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:05.709252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9981634365c4857b20ba59e7ece9f74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:05.710402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9981634365c4857b20ba59e7ece9f74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:05.733213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:05.736242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-752e5aea-0514-478c-8955-f45ef01ac1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9981634365c4857b20ba59e7ece9f74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:05.738061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:05.751851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 822/1652] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:05 2022] DELETE /identity/v3/users/c9981634365c4857b20ba59e7ece9f74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:05.756319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:05.756779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:05.757329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:05.794668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:05.796690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:05.895326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 831/1653] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:05.918014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:05.920208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:06.023905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 823/1654] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:06.059096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9312acc-1cec-4b2f-82bc-652012583c21 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:06.115763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:06.123626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:06.204911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:06.205616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:06.205895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:06.206258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:06.242488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:06.248225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:06.295112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a53c9b-bbeb-4197-9511-4dbfb5130a84 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:06.314574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 832/1655] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:06.322630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:06.340228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:06.340696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:06.340987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:06.373050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:06.386546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc464781-bd1c-4eda-b868-705e6a43c3de service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:06.477369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 824/1656] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:08.045733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:08.047264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:08.078854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178f931-03ac-4ca4-a183-c5950fed8748 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:08.084483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:08.085700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.091916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.092414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] PATH_INFO: `/v3/projects/e454a886d2414bca8129497695e28e41` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.094645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e454a886d2414bca8129497695e28e41)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:08.096621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:08.212894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e454a886d2414bca8129497695e28e41', 'request_id': 'req-aeadb455-c744-4e33-90ab-3a1855e4cfd7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:08.222903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e454a886d2414bca8129497695e28e41', 'request_id': 'req-aeadb455-c744-4e33-90ab-3a1855e4cfd7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:08.238368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e454a886d2414bca8129497695e28e41', 'request_id': 'req-aeadb455-c744-4e33-90ab-3a1855e4cfd7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:08.275205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] The token cache is being invalidate because project e454a886d2414bca8129497695e28e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:08.275205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:08.278315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aeadb455-c744-4e33-90ab-3a1855e4cfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:08.282157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 833/1657] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:08 2022] DELETE /identity/v3/projects/e454a886d2414bca8129497695e28e41 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:08.287185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.290255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.290620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.343836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:08.345639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:08.424403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 825/1658] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:08.432003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.432320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.432595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.474206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:08.475580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:08.526095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 834/1659] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:08.530384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:08.538896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:08.553273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d220f-0ca9-43c2-b92f-525be1699fa1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:08.569860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:08.571132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.571620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.572051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.572957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:08.574179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:08.578145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:08.602591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 826/1660] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:08.607090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:08.626480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210ffd9-d72f-4312-9a9e-cdfce5fd6f82 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:08.636358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:08.637186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.637366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.637644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.642132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:08.644054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:08.702992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 835/1661] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:08 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:08.709405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:08.739613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e7811-8e3c-4c34-aef4-143e9cce8efb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:08.913769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:08.914539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:08.916145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:08.916632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:08.917584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:08.926964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:08.980610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 827/1662] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:08 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:08.984609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:09.001213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b245fdb-e906-4ac1-b509-2466ff80a42c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:09.014699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:09.017006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:09.018243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:09.019558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:09.020640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:09.026408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:09.055116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 836/1663] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:09.060030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:09.078184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c96ce5c-5e21-452a-87ce-fa2eedd4c257 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:09.097585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:09.098344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:09.098623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:09.098931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:09.102304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:09.106300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb0f8e-1a8d-49ea-bf2c-3d48c628dd75 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:09.131718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 828/1664] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:09.133983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:09.151789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf5f89-5216-410a-85ba-169d1d52c663 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:09.170913 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:09.171865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:09.172148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:09.173047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] PATH_INFO: `/v3/projects/1f05e66812e94d238b6c38abd24677f6/users/f2768f0756b946aca25f59b3677d8029/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:09.215218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f05e66812e94d238b6c38abd24677f6, user_id=f2768f0756b946aca25f59b3677d8029, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:09.218000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:09.274610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 837/1665] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:09 2022] PUT /identity/v3/projects/1f05e66812e94d238b6c38abd24677f6/users/f2768f0756b946aca25f59b3677d8029/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:09.277511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:09.279197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:09.279713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:09.336059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] MFA Rules not processed for user `f2768f0756b946aca25f59b3677d8029`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:09.352877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:09.477418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 829/1666] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:09.488846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:09.490757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:09.585556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:09.670582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ffbf1-0625-46d0-b63b-f8a55c2f0816 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:09.677821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:09.678500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:09.678776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:09.679044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:09.703390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:09.705256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:09.719657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 838/1667] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:10.122447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:10.232221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:10.235362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:10.270661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7428b-25e7-493a-8789-e6ece370ee26 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:10.281744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:10.283425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:10.283774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:10.284181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] PATH_INFO: `/v3/users/f2768f0756b946aca25f59b3677d8029` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:10.285601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2768f0756b946aca25f59b3677d8029)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:10.289088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:10.297589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:10.411294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2768f0756b946aca25f59b3677d8029'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.421058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e5ecf-8035-45b8-b5b7-cb1c2b85f843 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:10.424161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2768f0756b946aca25f59b3677d8029'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.425217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2768f0756b946aca25f59b3677d8029'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.428082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2768f0756b946aca25f59b3677d8029'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.429400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:10.431997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:10.432855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:10.433229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] PATH_INFO: `/v3/users/f4f87abcddac45ffac8518a7d345fb2c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:10.434698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4f87abcddac45ffac8518a7d345fb2c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:10.437372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:10.453989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f74893a4-8cdc-4442-a31d-f6a1be87a330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2768f0756b946aca25f59b3677d8029'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.481977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 830/1668] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:10 2022] DELETE /identity/v3/users/f2768f0756b946aca25f59b3677d8029 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:10.485343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:10.485716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:10.486062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:10.525049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:10.526417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:10.554717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4f87abcddac45ffac8518a7d345fb2c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.590082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4f87abcddac45ffac8518a7d345fb2c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.638394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4f87abcddac45ffac8518a7d345fb2c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.640627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4f87abcddac45ffac8518a7d345fb2c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.641665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bad5da5d-ec3d-4194-ba51-3d4be57cc407 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4f87abcddac45ffac8518a7d345fb2c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:10.680364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 839/1669] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:10 2022] DELETE /identity/v3/users/f4f87abcddac45ffac8518a7d345fb2c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:10.684478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:10.684769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:10.685665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:10.737844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 831/1670] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:10.738034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:10.742815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:10.832378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:10.834478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:10.883624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:10.943429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 840/1671] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:10.980159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c54733-d882-43aa-8b6b-fd60e875c767 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:11.060008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:11.098098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:11.099270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:11.099734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:11.100235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:11.112858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:11.114644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b6206-3104-46ee-bcb1-ced6fd52629d service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:11.125661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 832/1672] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:11.136823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:11.137744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:11.160276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a628a9b-8969-4bd0-a24f-34d5cc291302 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:11.165793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:11.166707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:11.167052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:11.167499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:11.179495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:11.181121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:11.193052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 841/1673] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:12.713915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:12.714454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:12.714454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:12.766891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] MFA Rules not processed for user `0c1fd9d19f7143f8ba2288f4af40ed81`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:12.768160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:12.910391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 833/1674] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:12 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:12.914598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:12.916215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:12.942025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:12.942964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:12.948152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064328f0-3ff1-4055-9928-c819d9173cc8 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:12.965921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:12.966532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:12.966810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:12.967079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:12.967794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:12.969778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:12.976004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c4b90-b858-48c1-88fb-c5342de1c8c9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:12.983286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:12.984208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:12.984518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:12.984741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] PATH_INFO: `/v3/projects/1f05e66812e94d238b6c38abd24677f6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:12.991187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f05e66812e94d238b6c38abd24677f6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:12.992393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: WARNING py.warnings [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 07 04:04:12.992393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: warnings.warn(msg) Jul 07 04:04:12.992393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: Jul 07 04:04:12.993585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:13.059094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 842/1675] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:12 2022] POST /identity/v3/projects => generated 403 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:13.065332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.184617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f05e66812e94d238b6c38abd24677f6', 'request_id': 'req-167cef59-5226-4af4-a24e-0976e55646b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.210050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f05e66812e94d238b6c38abd24677f6', 'request_id': 'req-167cef59-5226-4af4-a24e-0976e55646b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.253104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f05e66812e94d238b6c38abd24677f6', 'request_id': 'req-167cef59-5226-4af4-a24e-0976e55646b3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.331934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] The token cache is being invalidate because project 1f05e66812e94d238b6c38abd24677f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:13.333415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.336390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-167cef59-5226-4af4-a24e-0976e55646b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.338558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 834/1676] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:12 2022] DELETE /identity/v3/projects/1f05e66812e94d238b6c38abd24677f6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:13.343888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c7fcf-6a05-492a-9e2a-55af0e18efba admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:13.344250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9ca5-d14e-41e4-ac12-ffdea90027d1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.344654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9ca5-d14e-41e4-ac12-ffdea90027d1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.345057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f9ca5-d14e-41e4-ac12-ffdea90027d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.386922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-de4f9ca5-d14e-41e4-ac12-ffdea90027d1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:13.392040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-de4f9ca5-d14e-41e4-ac12-ffdea90027d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:13.490417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:13.491424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.491897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.492483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.493352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:13.495455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:13.515174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:13.541832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 843/1677] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:13 2022] POST /identity/v3/users => generated 308 bytes in 477 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:13.546297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.551003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 835/1678] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:13.559051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.559334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.559604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.563317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:13.585110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c52c29-aade-4428-9262-f406f064ebc6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:13.601072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:13.601775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.602073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.603106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.605587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:13.608269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:13.632728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 844/1679] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:13.637161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.638897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:13.640502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:13.641585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:13.653132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 836/1680] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:13.654757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.669239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7cfb1-1952-4c32-a5b2-465a1a177aff None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:13.670568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdbea20-78f9-4af6-a13e-286f43fd8ebf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:13.675061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:13.677067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.677713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.678354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] PATH_INFO: `/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13/users/da71e46d3ecc41d187052e26967085fc/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.683087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:13.685011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.685394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.686099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] PATH_INFO: `/v3/projects/27cb2a2d5cca49228dd2bd42b15007d7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.688780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cb2a2d5cca49228dd2bd42b15007d7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:13.690817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:13.744742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b6c1a18a84f8b80b9ae8e6391ac13, user_id=da71e46d3ecc41d187052e26967085fc, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:13.755215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:13.775741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:13.783954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 837/1681] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:13 2022] PUT /identity/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13/users/da71e46d3ecc41d187052e26967085fc/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:13.786283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.795294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cb2a2d5cca49228dd2bd42b15007d7', 'request_id': 'req-03201bd5-adad-4c07-96bf-48de607e85e1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.808239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cb2a2d5cca49228dd2bd42b15007d7', 'request_id': 'req-03201bd5-adad-4c07-96bf-48de607e85e1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.830101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cb2a2d5cca49228dd2bd42b15007d7', 'request_id': 'req-03201bd5-adad-4c07-96bf-48de607e85e1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.852942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] The token cache is being invalidate because project 27cb2a2d5cca49228dd2bd42b15007d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:13.853442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.854247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:13.859208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 845/1682] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:13 2022] DELETE /identity/v3/projects/27cb2a2d5cca49228dd2bd42b15007d7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:13.860343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:13.862061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:13.953607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd47dd-14b3-4abf-bddb-bb90d2c69a09 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:13.965411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:13.966247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:13.966789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:13.968299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:13.970498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:13.971623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:13.976074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.001023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03201bd5-adad-4c07-96bf-48de607e85e1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.011185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 838/1683] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:14.012410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.016301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.017321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.018215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.020215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.020631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.022199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.027374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.046199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca15072-5fb3-4ac3-a529-b7b8d8155a1d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.053868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 846/1684] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:13 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:14.053868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.056802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.060034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.061229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.062168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.062541 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] PATH_INFO: `/v3/users/3d0a357266754f58827e63d13eb4231a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.066338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0a357266754f58827e63d13eb4231a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.070989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.090581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d09ae9-b157-47c3-bc4d-0f6698efe59c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.105017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.106589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.107484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.109010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.109819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.114524 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.179588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 847/1685] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:14 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:14.181086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.184597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0a357266754f58827e63d13eb4231a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:14.202221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0a357266754f58827e63d13eb4231a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:14.203034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0a357266754f58827e63d13eb4231a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:14.204222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0a357266754f58827e63d13eb4231a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:14.226658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de338042-40f7-44b9-85ed-ee23fd3da78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0a357266754f58827e63d13eb4231a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:14.268762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 839/1686] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:14 2022] DELETE /identity/v3/users/3d0a357266754f58827e63d13eb4231a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:14.272225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458607-0548-4f3e-ba98-c605de0ebbd3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.274976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458607-0548-4f3e-ba98-c605de0ebbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.278712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60458607-0548-4f3e-ba98-c605de0ebbd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.322423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-60458607-0548-4f3e-ba98-c605de0ebbd3 None None] MFA Rules not processed for user `029553978cc8405294ccb302665edbe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:14.330379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb0405-7323-464b-a8b7-981676bd3388 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.341409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-60458607-0548-4f3e-ba98-c605de0ebbd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.417088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:14.427526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:14.445603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.450072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.450604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.451417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] PATH_INFO: `/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13/users/da71e46d3ecc41d187052e26967085fc/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.454268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4b6c1a18a84f8b80b9ae8e6391ac13, user_id=da71e46d3ecc41d187052e26967085fc, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.457484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.471871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 848/1687] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:14 2022] PUT /identity/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13/users/da71e46d3ecc41d187052e26967085fc/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:14.472954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.487111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.506328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 840/1688] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:14.508097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.508097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.508386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.622077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] MFA Rules not processed for user `ca817816906a46a9a2423dc427fa3cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:14.625044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.653111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ffadf-5b1b-4e3f-b035-e9150e2f1298 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.664569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.666769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.666988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.667315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.679751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.688564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621615e7-ee0b-45cd-93b0-7b58034de703 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.763416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 849/1689] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:14 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:14.768438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.768996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.769533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.841796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] MFA Rules not processed for user `26ce1c1b87eb441bb883c639c92339d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:14.845434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:14.856554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 841/1690] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:14.857837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.878952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f9cd5-7627-404d-9015-b8ca6ecab764 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:14.894459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:14.895216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:14.895402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:14.895659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:14.896499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:14.905053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:14.938848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 842/1691] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:14.941920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:14.964695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:15.032912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 850/1692] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:15.033836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:15.061418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ced32b-b96c-46ff-85b3-ef5743b8cb79 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:15.075771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:15.076497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.076773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.077040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.077778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:15.079399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce51b1-ef11-4a1d-bfa2-2bcc3aa2fd18 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:15.107804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 851/1693] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:15.110350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.110644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.110923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.163792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] MFA Rules not processed for user `26ce1c1b87eb441bb883c639c92339d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:15.165069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:15.183126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf20a37-3cbc-4f04-b7a5-0aa855a25832 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:15.186420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 852/1694] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:15.187331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:15.213420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ace7a1-d91b-484c-825c-ec1452361e38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:15.215584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:15.219047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.219047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.220427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.225720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:15.226639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.226912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.227176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] PATH_INFO: `/v3/projects/3c26ca0af41f4f17976f97c43df298e8/users/e2c6d4cba67946d6b35d3de3c7a12357/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.260592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c26ca0af41f4f17976f97c43df298e8, user_id=e2c6d4cba67946d6b35d3de3c7a12357, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:15.263440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f392b84-afb1-4a0c-a2f6-3aa849f6e049 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:15.267050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:15.269517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:15.284161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 853/1695] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:15 2022] PUT /identity/v3/projects/3c26ca0af41f4f17976f97c43df298e8/users/e2c6d4cba67946d6b35d3de3c7a12357/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:15.294958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bae61-17c9-4b01-8183-1e275099d63f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.295627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bae61-17c9-4b01-8183-1e275099d63f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.296086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 843/1696] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:15.296817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bae61-17c9-4b01-8183-1e275099d63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.358784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-694bae61-17c9-4b01-8183-1e275099d63f None None] MFA Rules not processed for user `e2c6d4cba67946d6b35d3de3c7a12357`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:15.359747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-694bae61-17c9-4b01-8183-1e275099d63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:15.407448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:15.525472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:15.525859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 854/1697] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:15.542277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.542568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.542841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.560391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3332f5-3092-4796-a1c3-119a1be02856 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:15.605708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] MFA Rules not processed for user `aa55b383fe014d648c466919e16ffb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:15.607811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:15.650036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:15.707604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:15.708693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.709143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.711379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.712335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:15.723213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 855/1698] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:15.723213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:15.726150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e004d1-cdde-4870-8e3f-5ab7e3e16ab2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:15.771907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 844/1699] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/projects => generated 403 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:15.775147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.775735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.776242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:15.813662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] MFA Rules not processed for user `aa55b383fe014d648c466919e16ffb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:15.817041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:15.841170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f853b-af81-44e2-80e0-aa3984c42442 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:15.884811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:15.958197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 845/1700] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:15.958197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:15.980447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:15.981565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:15.983149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:15.983601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.068058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.071319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.083784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 856/1701] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:16.084825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8a5a-5966-4407-bad1-91ad6d958bf6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.095738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.097971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.099295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.099785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.100736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.107027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.166737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:16.166955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 846/1702] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:15 2022] POST /identity/v3/users => generated 308 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:16.183527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7c66f-2496-42ee-904c-6241479de7a5 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.201037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.201757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.202109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.202392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.203155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.208012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.240753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 857/1703] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:16.244843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:16.261161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff23a6-37d3-4aff-9f71-91cd56a66c5b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.276640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.277726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.277950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.278229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] PATH_INFO: `/v3/projects/d79bb9d7c9a645639f72d7239f645fd7/users/c5106fee4b1347748b86f24eb3e7ed5e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.316738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79bb9d7c9a645639f72d7239f645fd7, user_id=c5106fee4b1347748b86f24eb3e7ed5e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.328739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fd9d3-f16b-4cdf-bd77-312c5da30c36 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.363294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 847/1704] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:16 2022] PUT /identity/v3/projects/d79bb9d7c9a645639f72d7239f645fd7/users/c5106fee4b1347748b86f24eb3e7ed5e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:16.368713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:16.407832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f234e27-d8c3-4dc9-855a-9d6c363361e7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.488022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58f64-e9d2-47cc-9d87-dd0e78af6b74 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.488022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58f64-e9d2-47cc-9d87-dd0e78af6b74 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.488022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a58f64-e9d2-47cc-9d87-dd0e78af6b74 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.490182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 848/1705] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jul 7 04:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:16.504073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.504605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.505354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.650249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:16.651653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:16.673164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.674152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.674440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.674758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.675515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.679452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.683813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:16.704783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 858/1706] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:16.704783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:16.712933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:16.746349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a5abf8-12db-4fe4-89b0-013815d1b48d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.758939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.760724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.761045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.761315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] PATH_INFO: `/v3/projects/63cf464a54094dbab08bc004f45dc491` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.764342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cf464a54094dbab08bc004f45dc491)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.773355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.848539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 849/1707] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:04:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:16.851791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:16.896047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5253fdc8-685c-469a-abf3-fb7d704dbd9d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:16.918509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:16.928502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.929411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.929701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] PATH_INFO: `/v3/projects/d79bb9d7c9a645639f72d7239f645fd7/users/c5106fee4b1347748b86f24eb3e7ed5e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.933754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d79bb9d7c9a645639f72d7239f645fd7, user_id=c5106fee4b1347748b86f24eb3e7ed5e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:16.941009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097a392-2be6-451d-af07-87cefe81d5dd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:16.957840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cf464a54094dbab08bc004f45dc491', 'request_id': 'req-28c753f6-4f59-4062-8830-096fe7e4b4f3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:16.981474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cf464a54094dbab08bc004f45dc491', 'request_id': 'req-28c753f6-4f59-4062-8830-096fe7e4b4f3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:16.982009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 850/1708] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:16 2022] PUT /identity/v3/projects/d79bb9d7c9a645639f72d7239f645fd7/users/c5106fee4b1347748b86f24eb3e7ed5e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:16.983530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:16.983815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:16.984269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:16.986090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:16.990730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 851/1709] 10.222.0.26 () {54 vars in 912 bytes} [Thu Jul 7 04:04:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:16.991569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:17.007027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.012244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cf464a54094dbab08bc004f45dc491', 'request_id': 'req-28c753f6-4f59-4062-8830-096fe7e4b4f3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:17.039849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] The token cache is being invalidate because project 63cf464a54094dbab08bc004f45dc491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:17.040317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:17.041782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28c753f6-4f59-4062-8830-096fe7e4b4f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:17.045894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 859/1710] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:16 2022] DELETE /identity/v3/projects/63cf464a54094dbab08bc004f45dc491 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:17.050870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.052806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.053209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.127541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] MFA Rules not processed for user `c5106fee4b1347748b86f24eb3e7ed5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:17.129230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.223114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0ba83-152f-4461-a2c1-cbf49ac6e2ac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:17.242933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:17.245096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.245374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.245650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.255422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.289712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:17.291180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a8ff8-8ad5-42d2-9caf-5cba90359e64 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:17.313990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 852/1711] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:17.315389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f07fe-b916-43b0-a98d-ef0540d4514d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.315671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f07fe-b916-43b0-a98d-ef0540d4514d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.315943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6f07fe-b916-43b0-a98d-ef0540d4514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.358131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bd6f07fe-b916-43b0-a98d-ef0540d4514d None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:17.359367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bd6f07fe-b916-43b0-a98d-ef0540d4514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.383850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 853/1712] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:17.385324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.385608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.385881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.395628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 860/1713] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:17.408526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:17.411198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.441524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:17.446826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.559365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c48736-dbe2-404c-9293-3222bb47f467 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:17.567843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:17.569355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.569788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.570065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.586201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:17.590483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912f77e-b217-4a5a-87e7-663f7e6b5bbf service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:17.614425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 854/1714] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:17.617495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:17.620788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.634709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 861/1715] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:17.636734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.637020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.637292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.658083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71d605-a251-4506-a1d3-593eccc5644c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:17.671893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:17.672609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.672885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.673153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.695370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:17.696154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:17.697592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:17.705068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:17.712791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 855/1716] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:17.798103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 862/1717] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:17.799154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:17.822861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97a8856-1f43-4bbf-9fcb-ddb05d44141c service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:17.838860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:17.842333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.842830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.843435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.844990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:17.847694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:17.849906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47554700-b667-40a9-a8bd-0236e05bc438 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:17.897193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 856/1718] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:04:17.908854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:17.913021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a413b2-ab05-4705-b1a2-cf6d7e7a1d4d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:17.916340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.916631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.916906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.940001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:17.944726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:17.945011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:17.945286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:17.946022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:17.953812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:18.019487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] MFA Rules not processed for user `da71e46d3ecc41d187052e26967085fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:18.019487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.044974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 863/1719] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:18.044974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:18.049850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.068464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:18.171253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:18.210491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 857/1720] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:18.211923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89735a6-8f9f-4c7c-b05c-28a13ae2e10b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:18.212438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:18.218218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:18.219133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.219416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.219692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] PATH_INFO: `/v3/users/e2c6d4cba67946d6b35d3de3c7a12357` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.221073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2c6d4cba67946d6b35d3de3c7a12357)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:18.223634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:18.235947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05542739-db7d-47a5-aa06-6f66f9c739f7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:18.241220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:18.242141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.242577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.242989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.243894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:18.246121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a806ae1d-7f46-4f2a-8fba-65c17c7bf397 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:18.288195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 858/1721] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:18 2022] POST /identity/v3/users => generated 282 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:18.294917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd0fa-9353-43e2-8d6d-b6bf223812a2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.295200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd0fa-9353-43e2-8d6d-b6bf223812a2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.295656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afefd0fa-9353-43e2-8d6d-b6bf223812a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.383870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2c6d4cba67946d6b35d3de3c7a12357'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:18.398359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2c6d4cba67946d6b35d3de3c7a12357'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:18.411555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-afefd0fa-9353-43e2-8d6d-b6bf223812a2 None None] MFA Rules not processed for user `82a27d0525d942d99b3c5b19971208dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:18.415101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-afefd0fa-9353-43e2-8d6d-b6bf223812a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.450714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2c6d4cba67946d6b35d3de3c7a12357'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:18.451754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2c6d4cba67946d6b35d3de3c7a12357'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:18.454167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2c6d4cba67946d6b35d3de3c7a12357'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:18.490817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 864/1722] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:18 2022] DELETE /identity/v3/users/e2c6d4cba67946d6b35d3de3c7a12357 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:18.494734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:18.507216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.576680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 859/1723] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:18.578063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.578353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.578627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.613901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:18.616409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.743750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 860/1724] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:18.748044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:18.749876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.803402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ad71-d692-4314-bb0e-56d1a84482de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:18.820319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:18.851385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:18.852107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.852407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.852674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.864599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:18.879704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:18.902133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3a1be-ff14-4f92-93d2-b44818d53806 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:18.905879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 865/1725] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:18.905879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:18.905879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.920429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:18.921330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.921753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.922164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.925008 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:18.975794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d0dc2-81b0-4752-9b3a-fda3123835de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:18.979886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:18.980751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:18.981046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:18.981311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:18.999124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.000691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6eebe-bce7-4e3d-a1b4-3bb32d54920a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.014065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:19.040364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 866/1726] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:19.043586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6127a-8bb1-4722-92cd-b5fcee1f4b68 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.044168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6127a-8bb1-4722-92cd-b5fcee1f4b68 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.044769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6127a-8bb1-4722-92cd-b5fcee1f4b68 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.049574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 867/1727] 10.222.0.26 () {54 vars in 960 bytes} [Thu Jul 7 04:04:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:19.050807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6127a-8bb1-4722-92cd-b5fcee1f4b68 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.076613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6127a-8bb1-4722-92cd-b5fcee1f4b68 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.082956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.085308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.085808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.086274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.086692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.087753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.089624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab3979-3ee4-4378-a11c-09c10af534b9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.091569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.116931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 868/1728] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:19.118682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.119170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.119757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.120236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 861/1729] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:19.134966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.141358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:19.166787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:19.178614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:19.194720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6884cfff-e0ea-48dd-ba3b-d939dfa17fc3 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.207141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.207830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.208880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.209166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.290422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 869/1730] 10.222.0.26 () {58 vars in 1057 bytes} [Thu Jul 7 04:04:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:19.291685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.304614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.306353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.307415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b499f-f758-460e-88d3-c4d5e5ea83a3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.315970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.316978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.317260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.317579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] PATH_INFO: `/v3/projects/c4420ed85367444bb6a0239df4e4d1dc/users/20e738fbd42e4e59b20e07d0eb8cbf91/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.318439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 862/1731] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:19.319766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.321249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:19.339469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5078-61fb-4ff6-92eb-e83da7b6addb service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.339671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4420ed85367444bb6a0239df4e4d1dc, user_id=20e738fbd42e4e59b20e07d0eb8cbf91, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.342914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.345938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.347449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.347987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.348475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.351626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:19.372050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.373957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb68d8-0b06-4385-9b1a-0576b81dc976 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.380324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 870/1732] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:19 2022] PUT /identity/v3/projects/c4420ed85367444bb6a0239df4e4d1dc/users/20e738fbd42e4e59b20e07d0eb8cbf91/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:19.381583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.404309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 863/1733] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:19.411615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.412316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.412966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.470461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] MFA Rules not processed for user `20e738fbd42e4e59b20e07d0eb8cbf91`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:19.471978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:19.526973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:19.565273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e63-4988-4289-bd70-fed9b8ce6ead admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.573227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.574183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.574703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.575067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.590010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 864/1734] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:19 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:19.592103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.594813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.595405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.617256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 871/1735] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:19.714751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f59dfa-4f2f-426e-bcb5-315b75912c77 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.721533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.722314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.722652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.722930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.723770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.727968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:19.769588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 865/1736] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:19 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:19.773965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:19.787815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de04f0f7-c6fa-4d5f-a8aa-930e02728826 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:19.927305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:19.958374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:19.965263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:19.966347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:19.966631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:19.980599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:19.982672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:20.045131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 872/1737] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:19 2022] POST /identity/v3/users => generated 289 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:20.049217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:20.070125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36dee03-c2d4-427a-bab8-b3b0db18759a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:20.084974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:20.085684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:20.085967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:20.086239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:20.087143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:20.091270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:20.117384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 866/1738] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:20.121471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:20.138530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49ded6-88d6-47e3-9e46-d639d05424bb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:20.152839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:20.154080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:20.154594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:20.155147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] PATH_INFO: `/v3/projects/5eff8395064841ab841160b5688d1809/users/68714a45dd6749d5954dafed301f43c8/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:20.188620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eff8395064841ab841160b5688d1809, user_id=68714a45dd6749d5954dafed301f43c8, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:20.203518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:20.264704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 873/1739] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:20 2022] PUT /identity/v3/projects/5eff8395064841ab841160b5688d1809/users/68714a45dd6749d5954dafed301f43c8/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:20.268790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:20.290555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676b041-2e90-4bbc-b698-92df37274d33 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:20.448908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:20.453419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:20.455651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:20.460002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:20.463650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:20.467875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b80155d-ac76-45ad-86fa-085e85b7d6cd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:20.501022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 867/1740] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:20.505368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:20.521465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf1d12-b4e6-4db0-b3d7-5a208dec9895 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:20.535327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:20.536901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:20.537329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:20.537746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] PATH_INFO: `/v3/projects/5eff8395064841ab841160b5688d1809/users/68714a45dd6749d5954dafed301f43c8/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:20.547975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eff8395064841ab841160b5688d1809, user_id=68714a45dd6749d5954dafed301f43c8, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:20.557006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:20.591851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 874/1741] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:20 2022] PUT /identity/v3/projects/5eff8395064841ab841160b5688d1809/users/68714a45dd6749d5954dafed301f43c8/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:20.603581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51daca-fbfc-4bdf-bb82-3704f9fd9cf8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:20.604178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51daca-fbfc-4bdf-bb82-3704f9fd9cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:20.604649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51daca-fbfc-4bdf-bb82-3704f9fd9cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:20.680905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9c51daca-fbfc-4bdf-bb82-3704f9fd9cf8 None None] MFA Rules not processed for user `68714a45dd6749d5954dafed301f43c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:20.682572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9c51daca-fbfc-4bdf-bb82-3704f9fd9cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:20.795016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:20.930123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 868/1742] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:20.939677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:20.941678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:21.075508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd324b-2c4e-414c-bbe8-0d529f55c79d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:21.081106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5a38-3431-4800-a580-554f4f25caf4 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.081478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5a38-3431-4800-a580-554f4f25caf4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.082874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc5a38-3431-4800-a580-554f4f25caf4 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.083801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 869/1743] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 07 04:04:21.091200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:21.091881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.092183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.092456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.117262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.117858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.117858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.129818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:21.139498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:21.167012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:21.171968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:21.172621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 875/1744] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:21.321642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 870/1745] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:04:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:21.351271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:21.363997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d052d5-637f-49ad-93b4-44a69430c034 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:21.373607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:21.383063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:21.383630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.383975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.386900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.396322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559bb5dc-72ff-4084-82c9-1313687cc11e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:21.424885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:21.425568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.425851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.426120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.452760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:21.454417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a00cb-4828-413c-918e-10210ff3e422 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:21.501142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 871/1746] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:21.502692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:21.503024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:21.503282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:21.551293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] MFA Rules not processed for user `26ce1c1b87eb441bb883c639c92339d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:21.552908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:21.594769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:21.597437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:21.629887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 876/1747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:21 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:21.749247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 872/1748] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:22.307855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:22.309650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:22.434410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:22.519208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac997081-0be0-4c98-b348-07bdf4657dc7 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:22.541625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:22.542534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:22.546993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:22.547340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] PATH_INFO: `/v3/projects/3c26ca0af41f4f17976f97c43df298e8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:22.564032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c26ca0af41f4f17976f97c43df298e8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:22.571838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:22.780200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c26ca0af41f4f17976f97c43df298e8', 'request_id': 'req-981f6602-bfa8-45fc-ba91-ca046f8c3767'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:22.806631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c26ca0af41f4f17976f97c43df298e8', 'request_id': 'req-981f6602-bfa8-45fc-ba91-ca046f8c3767'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:22.829972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c26ca0af41f4f17976f97c43df298e8', 'request_id': 'req-981f6602-bfa8-45fc-ba91-ca046f8c3767'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:22.868592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] The token cache is being invalidate because project 3c26ca0af41f4f17976f97c43df298e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:22.868880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:22.871320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-981f6602-bfa8-45fc-ba91-ca046f8c3767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:22.875881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 877/1749] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:22 2022] DELETE /identity/v3/projects/3c26ca0af41f4f17976f97c43df298e8 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:22.880152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:22.903172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec35f8-cbaf-4c02-ac5b-d2d7d140a3a4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:23.044456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:23.070130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:23.071039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:23.071313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:23.074714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] PATH_INFO: `/v3/users/c5106fee4b1347748b86f24eb3e7ed5e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:23.077260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5106fee4b1347748b86f24eb3e7ed5e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:23.097813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:23.148607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:23.148607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:23.148800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:23.180178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:23.181501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:23.221766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5106fee4b1347748b86f24eb3e7ed5e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:23.243277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5106fee4b1347748b86f24eb3e7ed5e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:23.244151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5106fee4b1347748b86f24eb3e7ed5e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:23.244986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5106fee4b1347748b86f24eb3e7ed5e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:23.267496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d0e509f1-c591-4287-9c16-f5f8295f6680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5106fee4b1347748b86f24eb3e7ed5e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:23.314472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 878/1750] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:04:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:23.352659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 873/1751] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:22 2022] DELETE /identity/v3/users/c5106fee4b1347748b86f24eb3e7ed5e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:23.613721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:23.617724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:23.869315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005ef11-6f36-413d-a20e-12404917f2d6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:23.893476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:23.978717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:23.992279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:23.992929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:23.993376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:24.136002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:24.138225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401674a2-6d8a-4fb2-a602-74b70cb25fb6 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:24.152866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 879/1752] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:04:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:04:24.559607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:24.560842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:24.561127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:24.562965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 874/1753] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:24.587576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:24.587934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:24.588233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:24.641908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] MFA Rules not processed for user `fc67945c16854249b102555f7864d148`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:24.646432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:24.778274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:24.780268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:24.911938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 880/1754] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:04:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:25.012352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcd002-a343-479d-b097-b4b86f08bed5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:25.026441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:25.027664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:25.027931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:25.028382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] PATH_INFO: `/v3/users/0c1fd9d19f7143f8ba2288f4af40ed81` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:25.029980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:25.030538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1fd9d19f7143f8ba2288f4af40ed81)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:25.032611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:25.033240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:25.065563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913aae1e-1418-4653-93e2-2a0be7b17434 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:25.084842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:25.088822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:25.089407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:25.090891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:25.141574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:25.179944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1fd9d19f7143f8ba2288f4af40ed81'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.199576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:25.242977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 881/1755] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:25.256664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1fd9d19f7143f8ba2288f4af40ed81'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.257954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1fd9d19f7143f8ba2288f4af40ed81'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.260649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1fd9d19f7143f8ba2288f4af40ed81'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.333444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65c73042-d7c9-4199-b06f-26a3cf9d8b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1fd9d19f7143f8ba2288f4af40ed81'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.348168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:25.376606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 875/1756] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:24 2022] DELETE /identity/v3/users/0c1fd9d19f7143f8ba2288f4af40ed81 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:25.477131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:25.481209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:25.526591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dabb0b-f711-47a7-a303-e5a586b4da39 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:25.710566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:25.765874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:25.766832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:25.767124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:25.767387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] PATH_INFO: `/v3/users/20e738fbd42e4e59b20e07d0eb8cbf91` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:25.768875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e738fbd42e4e59b20e07d0eb8cbf91)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:25.773984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:25.925902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e738fbd42e4e59b20e07d0eb8cbf91'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:25.969596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e738fbd42e4e59b20e07d0eb8cbf91'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:26.029795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e738fbd42e4e59b20e07d0eb8cbf91'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:26.030588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e738fbd42e4e59b20e07d0eb8cbf91'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:26.031221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e738fbd42e4e59b20e07d0eb8cbf91'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:26.049999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 882/1757] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:25 2022] DELETE /identity/v3/users/20e738fbd42e4e59b20e07d0eb8cbf91 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:26.054667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83530d69-5cc5-4777-a2f9-88bcde076795 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:26.055230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83530d69-5cc5-4777-a2f9-88bcde076795 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:26.055230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83530d69-5cc5-4777-a2f9-88bcde076795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:26.099146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-83530d69-5cc5-4777-a2f9-88bcde076795 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:26.099819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-83530d69-5cc5-4777-a2f9-88bcde076795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:26.341765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 876/1758] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:26.620957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:26.623370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:26.887378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfecab4-e16d-4d78-8e0d-f3f0c4251516 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:26.902743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:26.903540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:26.903824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:26.908324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:26.961080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:26.965388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:27.018121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 883/1759] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:27.153090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2db82-d46e-4fb2-b6dd-4f02bef28a43 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.154088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2db82-d46e-4fb2-b6dd-4f02bef28a43 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.154572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2db82-d46e-4fb2-b6dd-4f02bef28a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.196419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:27.197841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.203715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dde2db82-d46e-4fb2-b6dd-4f02bef28a43 None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:27.205298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dde2db82-d46e-4fb2-b6dd-4f02bef28a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.225732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 877/1760] 10.222.0.18 () {58 vars in 1015 bytes} [Thu Jul 7 04:04:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:27.239941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae274f-c5aa-4d20-b883-3a8c9e4ee664 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:27.251606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:27.270855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.271141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.272996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] PATH_INFO: `/v3/projects/d79bb9d7c9a645639f72d7239f645fd7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.276240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d79bb9d7c9a645639f72d7239f645fd7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:27.282725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:27.293859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919ef5-731a-4a06-8658-4bf6c3b174f1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.294172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919ef5-731a-4a06-8658-4bf6c3b174f1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.294453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7919ef5-731a-4a06-8658-4bf6c3b174f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.333577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f7919ef5-731a-4a06-8658-4bf6c3b174f1 None None] MFA Rules not processed for user `82a27d0525d942d99b3c5b19971208dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:27.339318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7919ef5-731a-4a06-8658-4bf6c3b174f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.440051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd79bb9d7c9a645639f72d7239f645fd7', 'request_id': 'req-ea533803-d53f-4c0d-9257-c5290d30a334'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:27.474470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd79bb9d7c9a645639f72d7239f645fd7', 'request_id': 'req-ea533803-d53f-4c0d-9257-c5290d30a334'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:27.514396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd79bb9d7c9a645639f72d7239f645fd7', 'request_id': 'req-ea533803-d53f-4c0d-9257-c5290d30a334'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:27.529226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:27.589599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] The token cache is being invalidate because project d79bb9d7c9a645639f72d7239f645fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:27.592784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:27.596884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:27.599961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 884/1761] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:27 2022] DELETE /identity/v3/projects/d79bb9d7c9a645639f72d7239f645fd7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:27.612724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:27.622276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.624030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 878/1762] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:27.629760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.630150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.630423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.681546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] MFA Rules not processed for user `ca817816906a46a9a2423dc427fa3cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:27.695681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.836240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 879/1763] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:27.837623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:27.839259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.867705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea533803-d53f-4c0d-9257-c5290d30a334 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:27.882940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:27.883544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.883821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.884093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.890565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:27.914120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:27.915723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef115a-ff69-4b49-8986-41718ee8d2c1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:27.962070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 885/1764] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:27.964687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746944-47e0-4fd8-ab86-a364a585f600 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:27.964977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746944-47e0-4fd8-ab86-a364a585f600 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:27.965255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd746944-47e0-4fd8-ab86-a364a585f600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:27.970034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:28.025592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bd746944-47e0-4fd8-ab86-a364a585f600 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:28.033756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd746944-47e0-4fd8-ab86-a364a585f600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:28.077311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 886/1765] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:28.078998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.079171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55068c1-cf2e-4f91-b689-7d9e5391018c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:28.079326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.086104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.118484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:28.120319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.120703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.120982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] PATH_INFO: `/v3/projects/9d5f86f5bc6045d5b29ecc1ac9dbd121` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.123007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d5f86f5bc6045d5b29ecc1ac9dbd121)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:28.126969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:28.200310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:28.202045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:28.221717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 887/1766] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:28.226757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:28.253208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df867a1a-dc84-4601-90a0-eaf7f2b72dbe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:28.270734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:28.271494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.271971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.276548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.280660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:28.281451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:28.283128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:28.324464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 888/1767] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:28.327084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:28.345727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d5f86f5bc6045d5b29ecc1ac9dbd121', 'request_id': 'req-2e5260ad-9ed3-4632-ad27-f3a341c1016c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.360362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e1776-edc1-4c50-aff2-e166fcf3d0bf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:28.366515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d5f86f5bc6045d5b29ecc1ac9dbd121', 'request_id': 'req-2e5260ad-9ed3-4632-ad27-f3a341c1016c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.380157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d5f86f5bc6045d5b29ecc1ac9dbd121', 'request_id': 'req-2e5260ad-9ed3-4632-ad27-f3a341c1016c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.422246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] The token cache is being invalidate because project 9d5f86f5bc6045d5b29ecc1ac9dbd121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:28.422444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.425356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.429315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 880/1768] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:27 2022] DELETE /identity/v3/projects/9d5f86f5bc6045d5b29ecc1ac9dbd121 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:28.433132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:28.434876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:28.553011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:28.554311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.554761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.555236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.555924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:28.562301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:28.634468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5260ad-9ed3-4632-ad27-f3a341c1016c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:28.641636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 889/1769] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:28 2022] POST /identity/v3/projects => generated 387 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:28.643191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:28.644439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.645260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.645616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] PATH_INFO: `/v3/users/da71e46d3ecc41d187052e26967085fc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.646014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:28.647307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=da71e46d3ecc41d187052e26967085fc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:28.649051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:28.650918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:28.810206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da71e46d3ecc41d187052e26967085fc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.826505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:28.835812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da71e46d3ecc41d187052e26967085fc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.838946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da71e46d3ecc41d187052e26967085fc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.840684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da71e46d3ecc41d187052e26967085fc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.866802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1f3f8-a121-4471-9199-d94cd762b080 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:28.880413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:28.885490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:28.885872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:28.886301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:28.889036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:28.894023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:28.902994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da71e46d3ecc41d187052e26967085fc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:28.909194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:28.966682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 881/1770] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:28 2022] DELETE /identity/v3/users/da71e46d3ecc41d187052e26967085fc => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:28.980188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 890/1771] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:28 2022] POST /identity/v3/users => generated 294 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:28.984455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:28.989551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:29.203489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb13fa-de17-4b83-a6c0-2e893af41bbd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:29.210777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:29.220448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:29.220739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:29.221270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:29.221839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:29.223764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:29.272823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 882/1772] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:29.276808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:29.296767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16a4350-0adf-4bc3-a352-d8480ae331c3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:29.336939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:29.337808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:29.340619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:29.341152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:29.341900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:29.343819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356e4ae-d008-4afa-ba4d-4585d1ce62c4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:29.371201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 891/1773] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:29.375402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:29.404480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84086305-cde6-4b31-8666-bed96d277839 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:29.412612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:29.414221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:29.414610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:29.414998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] PATH_INFO: `/v3/projects/3ad1027838cb4e7e90f585bc37235c7a/users/e1507397adaa4c7db1df15d20dca528a/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:29.467010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad1027838cb4e7e90f585bc37235c7a, user_id=e1507397adaa4c7db1df15d20dca528a, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:29.477071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:29.526202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 883/1774] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:29 2022] PUT /identity/v3/projects/3ad1027838cb4e7e90f585bc37235c7a/users/e1507397adaa4c7db1df15d20dca528a/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:29.528231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:29.528674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:29.529154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:29.619424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] MFA Rules not processed for user `e1507397adaa4c7db1df15d20dca528a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:29.621311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:29.722631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:29.724741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:29.850930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 892/1775] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:29.851886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.004905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797e94c-7377-43d0-8847-830c8137564f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.029861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.035442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.036831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.038134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] PATH_INFO: `/v3/projects/c4420ed85367444bb6a0239df4e4d1dc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.041968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4420ed85367444bb6a0239df4e4d1dc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.052389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.116889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdff867-72d8-4105-a84e-5c9137c9c768 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.127276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.128133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.128578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.131382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.132168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.134163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.203156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 893/1776] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:29 2022] POST /identity/v3/projects => generated 389 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:30.204264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.209834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4420ed85367444bb6a0239df4e4d1dc', 'request_id': 'req-46c5a6ae-4c4f-443e-a0ad-1d981040030d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.228512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4420ed85367444bb6a0239df4e4d1dc', 'request_id': 'req-46c5a6ae-4c4f-443e-a0ad-1d981040030d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.242807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:30.247902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4420ed85367444bb6a0239df4e4d1dc', 'request_id': 'req-46c5a6ae-4c4f-443e-a0ad-1d981040030d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.278875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] The token cache is being invalidate because project c4420ed85367444bb6a0239df4e4d1dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:30.279226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.280897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.288269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 884/1777] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:29 2022] DELETE /identity/v3/projects/c4420ed85367444bb6a0239df4e4d1dc => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:30.289523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.291236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:30.304642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:30.341327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6eaf44-c741-468c-aba5-b85135086a72 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.361126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.361758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.362033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.362313 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.363022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.365118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.426500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 894/1778] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:30 2022] POST /identity/v3/users => generated 301 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:30.427950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.433086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:30.466431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269272b3-caed-4143-b3c7-0499dbd0eea3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.482429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.483233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.483508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.483781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.484641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.486465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.491079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c5a6ae-4c4f-443e-a0ad-1d981040030d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.506116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.507017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.507299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.507648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] PATH_INFO: `/v3/users/68714a45dd6749d5954dafed301f43c8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.509494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=68714a45dd6749d5954dafed301f43c8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.517307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 895/1779] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:30.517939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.518155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.529921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a9cd0a-0866-43b2-a4f1-aeffda843c50 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:30.545487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:30.546568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:30.546904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:30.547241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] PATH_INFO: `/v3/projects/300cdf6769ce48e1a79f30998289e262/users/71ebc386153c4a50bc113b65acf9bd9b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:30.578080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=300cdf6769ce48e1a79f30998289e262, user_id=71ebc386153c4a50bc113b65acf9bd9b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:30.581535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:30.646978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 896/1780] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:30 2022] PUT /identity/v3/projects/300cdf6769ce48e1a79f30998289e262/users/71ebc386153c4a50bc113b65acf9bd9b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:30.652962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.672469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68714a45dd6749d5954dafed301f43c8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.691534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68714a45dd6749d5954dafed301f43c8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.692777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68714a45dd6749d5954dafed301f43c8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.693514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68714a45dd6749d5954dafed301f43c8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.727266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68714a45dd6749d5954dafed301f43c8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:30.753565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 885/1781] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:30 2022] DELETE /identity/v3/users/68714a45dd6749d5954dafed301f43c8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:30.810498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:30.811736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:30.897171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346445ed-8b83-402a-aa53-d085df5cd2ec admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.027794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6024f-364e-41d8-b928-a186c17de8eb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.042312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:31.043203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.043686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.044603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] PATH_INFO: `/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.048691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4b6c1a18a84f8b80b9ae8e6391ac13)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:31.053761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:31.055432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:31.056224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.056511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.056850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.059680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:31.066157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:31.081665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:31.104935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 897/1782] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:30 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:31.105897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:31.118771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:31.164202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd4e5-0827-4dd0-97d4-c61d686ac75f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.197351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:31.198277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.198687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.198803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] PATH_INFO: `/v3/projects/300cdf6769ce48e1a79f30998289e262/users/71ebc386153c4a50bc113b65acf9bd9b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.212981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4b6c1a18a84f8b80b9ae8e6391ac13', 'request_id': 'req-8c504afc-ba9f-4383-a799-877dc55d258a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:31.215805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=300cdf6769ce48e1a79f30998289e262, user_id=71ebc386153c4a50bc113b65acf9bd9b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:31.220666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d5c60-6686-4672-8b3c-8b6c6f284698 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:31.225735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4b6c1a18a84f8b80b9ae8e6391ac13', 'request_id': 'req-8c504afc-ba9f-4383-a799-877dc55d258a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:31.246066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4b6c1a18a84f8b80b9ae8e6391ac13', 'request_id': 'req-8c504afc-ba9f-4383-a799-877dc55d258a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:31.272567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 898/1783] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:31 2022] PUT /identity/v3/projects/300cdf6769ce48e1a79f30998289e262/users/71ebc386153c4a50bc113b65acf9bd9b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:31.286699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.287221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.287683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.298543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] The token cache is being invalidate because project cd4b6c1a18a84f8b80b9ae8e6391ac13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:31.298806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:31.303623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c504afc-ba9f-4383-a799-877dc55d258a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:31.307955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 886/1784] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:30 2022] DELETE /identity/v3/projects/cd4b6c1a18a84f8b80b9ae8e6391ac13 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:31.312896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc16d-10bf-4d57-a45c-5ed40e7103a9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.313187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc16d-10bf-4d57-a45c-5ed40e7103a9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.313470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc16d-10bf-4d57-a45c-5ed40e7103a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.367470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc2fc16d-10bf-4d57-a45c-5ed40e7103a9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:31.368832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc2fc16d-10bf-4d57-a45c-5ed40e7103a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:31.381932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] MFA Rules not processed for user `71ebc386153c4a50bc113b65acf9bd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:31.383202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:31.483029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:31.538492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 887/1785] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:31.545754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.545970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.546371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.602086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:31.606533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:31.641694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 888/1786] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:31.645629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:31.686089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca5a32-03da-45bb-b428-5fcd46c3ab58 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.703430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:31.705179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.711184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 899/1787] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:31.715099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.715638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.719625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:31.720379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:31.725462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:31.727292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:31.727420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:31.781619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 889/1788] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:31.786204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:31.813365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a571d42-10f9-4f22-8421-e4585f2b396c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.831737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:31.833004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:31.833553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:31.835637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:31.836846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:31.842199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:31.918520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 890/1789] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:31 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:31.928434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde87744-b815-4c4a-9e2e-578f9e30af02 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:31.929125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:32.095988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.096846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.097223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.097611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.181986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8dec7a-ee2d-4027-b68b-501c11afe1f5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:32.206723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.207868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.208165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.208439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.209472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:32.211505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:32.260949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:32.306835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 891/1790] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:31 2022] POST /identity/v3/users => generated 287 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:32.307860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:32.328239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:32.329798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:32.349376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e8d3b-2617-4802-bc84-02b9614063e5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:32.362531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.363195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.365730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 900/1791] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:31 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:32.367628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.367922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.369307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:32.371137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:32.409312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:32.437630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 892/1792] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:32.446425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a783f9-114a-43d3-b18c-cf4cd20597d8 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:32.459704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.460688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.461215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.461631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.462651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:32.464978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:32.504197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:32.521685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e98a3-e9fc-49ee-bebe-fce688a67d24 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:32.522446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 901/1793] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:32.530367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.531467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.531908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.532445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] PATH_INFO: `/v3/projects/404d88b1bac843689abf6785b6ef481a/users/b610cb0dc92d447291ff47991d06c8b7/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.619273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=404d88b1bac843689abf6785b6ef481a, user_id=b610cb0dc92d447291ff47991d06c8b7, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:32.627862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79498bd-e327-4979-9d19-1ca2f5c05c68 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:32.646970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:32.649817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:32.673278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 893/1794] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:32 2022] PUT /identity/v3/projects/404d88b1bac843689abf6785b6ef481a/users/b610cb0dc92d447291ff47991d06c8b7/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:32.676522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.677175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.684192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.699476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739bb52-dd18-4de7-a917-eeaec54d17c8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:32.734501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:32.804044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] MFA Rules not processed for user `b610cb0dc92d447291ff47991d06c8b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:32.812699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:32.980858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:32.982163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:32.982368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:32.995300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] PATH_INFO: `/v3/users/e1507397adaa4c7db1df15d20dca528a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:32.996864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1507397adaa4c7db1df15d20dca528a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:33.014392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:33.082181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 894/1795] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:33.087084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:33.114995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c5bb6-dd0e-492b-91e7-4d3ef43dde9b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:33.130535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:33.132338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:33.136702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:33.137006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:33.137786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:33.143817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:33.203933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 895/1796] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:33.208210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:33.223647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1507397adaa4c7db1df15d20dca528a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:33.238199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1507397adaa4c7db1df15d20dca528a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:33.278921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1507397adaa4c7db1df15d20dca528a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:33.280473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1507397adaa4c7db1df15d20dca528a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:33.281733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c42cb22-c88b-4ec4-931b-63ea8ea23e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1507397adaa4c7db1df15d20dca528a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:33.330942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 902/1797] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:32 2022] DELETE /identity/v3/users/e1507397adaa4c7db1df15d20dca528a => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:33.342051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:33.342486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:33.342813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:33.402063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f765f-a438-4783-abfa-a1db1160d9cb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:33.428345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:33.429285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:33.480830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:33.663130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:33.663891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:33.664230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:33.669417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:33.674709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:33.678819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:33.690411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 903/1798] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:33.755933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 896/1799] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:33 2022] POST /identity/v3/users => generated 293 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:33.760546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:33.763766 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:33.782205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20f088-c0ea-475b-8b5a-93c0a628a664 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:33.795192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:33.797558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:33.798037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:33.798535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:33.799481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:33.804834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:33.823624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 904/1800] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:33.827798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:33.850332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c35b89-61de-4c44-87f8-f3477590afb1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:33.878622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:33.879846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:33.880063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:33.880363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] PATH_INFO: `/v3/projects/e321b1f3d67a42d7b64f10fc850463eb/users/d07b61aa55d64c45b0c1b6185d666dec/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:33.886617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:33.888409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:33.957007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e321b1f3d67a42d7b64f10fc850463eb, user_id=d07b61aa55d64c45b0c1b6185d666dec, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:33.962805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:33.977308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:34.015465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 897/1801] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:33 2022] PUT /identity/v3/projects/e321b1f3d67a42d7b64f10fc850463eb/users/d07b61aa55d64c45b0c1b6185d666dec/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:34.019567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:34.109053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292c0b07-9d9f-46b7-a329-7a43f4cb411a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:34.241757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11302fbb-7f59-4dc9-84f2-ce69cf97c19d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:34.255616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:34.256666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:34.257031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:34.257392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:34.258470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:34.260417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:34.297742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 898/1802] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:34 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:34.298844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:34.342363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1801d-6b29-4e14-83f7-6433ea41583f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:34.353504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:34.354512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:34.354805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:34.357034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:34.358409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:34.358509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] PATH_INFO: `/v3/projects/e321b1f3d67a42d7b64f10fc850463eb/users/d07b61aa55d64c45b0c1b6185d666dec/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:34.359599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:34.359892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:34.362713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e321b1f3d67a42d7b64f10fc850463eb, user_id=d07b61aa55d64c45b0c1b6185d666dec, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:34.366938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77d45f-710a-4662-ab2f-44a7c2afec4b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:34.384318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:34.385783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:34.405305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 899/1803] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:34 2022] PUT /identity/v3/projects/e321b1f3d67a42d7b64f10fc850463eb/users/d07b61aa55d64c45b0c1b6185d666dec/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:34.417371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e684e1-235f-43a9-b6a9-44d6a280b6d9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:34.417657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e684e1-235f-43a9-b6a9-44d6a280b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:34.417931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e684e1-235f-43a9-b6a9-44d6a280b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:34.423301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 905/1804] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:34.478399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-40e684e1-235f-43a9-b6a9-44d6a280b6d9 None None] MFA Rules not processed for user `d07b61aa55d64c45b0c1b6185d666dec`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:34.481229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-40e684e1-235f-43a9-b6a9-44d6a280b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:34.646956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 900/1805] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:34.671843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:34.674601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:34.872411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5de8ac-f91f-4b1e-a954-add9056365f6 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:35.041663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:35.045237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:35.045695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:35.046093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:35.080489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:35.083567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57864f9-a355-4cc5-bddf-83cbdd8c9589 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:35.135396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 906/1806] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:35.871436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d6a8-940c-4890-8e21-f2aaeb11af6d None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:35.872046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d6a8-940c-4890-8e21-f2aaeb11af6d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:35.872046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15d6a8-940c-4890-8e21-f2aaeb11af6d None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:35.874104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 901/1807] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:35.982970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8071-a653-442d-aeb5-d9dd08768351 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:35.983472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8071-a653-442d-aeb5-d9dd08768351 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:35.983725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba8071-a653-442d-aeb5-d9dd08768351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:36.042312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1fba8071-a653-442d-aeb5-d9dd08768351 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:36.044206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1fba8071-a653-442d-aeb5-d9dd08768351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:36.128169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d6a8-940c-4890-8e21-f2aaeb11af6d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:36.134419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:36.190662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:36.354516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 907/1808] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:04:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:36.427581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15d6a8-940c-4890-8e21-f2aaeb11af6d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:36.433575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:36.434744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:36.435375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:36.435877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] PATH_INFO: `/v3/users/b610cb0dc92d447291ff47991d06c8b7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:36.437430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b610cb0dc92d447291ff47991d06c8b7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:36.439879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:36.535880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17742b-2f39-4e83-834d-49652824943b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:36.536301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17742b-2f39-4e83-834d-49652824943b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:36.536473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17742b-2f39-4e83-834d-49652824943b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:36.538552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 908/1809] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:36.619057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b610cb0dc92d447291ff47991d06c8b7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:36.644778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b610cb0dc92d447291ff47991d06c8b7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:36.666017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b610cb0dc92d447291ff47991d06c8b7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:36.668711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b610cb0dc92d447291ff47991d06c8b7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:36.723769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b610cb0dc92d447291ff47991d06c8b7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:36.757031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 902/1810] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:36 2022] DELETE /identity/v3/users/b610cb0dc92d447291ff47991d06c8b7 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:36.762363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e490-4553-4ef9-9b93-8cb8a675cb1d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:36.763135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e490-4553-4ef9-9b93-8cb8a675cb1d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:36.764301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e490-4553-4ef9-9b93-8cb8a675cb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:36.790985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f7a5e490-4553-4ef9-9b93-8cb8a675cb1d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:36.792777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f7a5e490-4553-4ef9-9b93-8cb8a675cb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:36.897724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:36.901358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.008616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 909/1811] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:37.143290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a869-b0ec-48d0-b7de-2c227bf421b4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:37.164907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:37.165984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.166269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.166548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] PATH_INFO: `/v3/projects/5eff8395064841ab841160b5688d1809` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.169587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eff8395064841ab841160b5688d1809)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:37.171605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:37.271968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:37.277531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74480-0dd8-4224-bd90-12f78bae0c02 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.277819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74480-0dd8-4224-bd90-12f78bae0c02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.278443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf74480-0dd8-4224-bd90-12f78bae0c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.321461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9cf74480-0dd8-4224-bd90-12f78bae0c02 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:37.324287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9cf74480-0dd8-4224-bd90-12f78bae0c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.331108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eff8395064841ab841160b5688d1809', 'request_id': 'req-04eee121-3a91-48c8-b9af-bcc76b402ab6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:37.371130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eff8395064841ab841160b5688d1809', 'request_id': 'req-04eee121-3a91-48c8-b9af-bcc76b402ab6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:37.382687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eff8395064841ab841160b5688d1809', 'request_id': 'req-04eee121-3a91-48c8-b9af-bcc76b402ab6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:37.418011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] The token cache is being invalidate because project 5eff8395064841ab841160b5688d1809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:37.418316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:37.420732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:37.422951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 903/1812] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:36 2022] DELETE /identity/v3/projects/5eff8395064841ab841160b5688d1809 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:37.424066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:37.437032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.514746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 910/1813] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:04:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:37.516700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f294-e182-48d0-a3eb-cab28e3ee821 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.517203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f294-e182-48d0-a3eb-cab28e3ee821 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.517675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4f294-e182-48d0-a3eb-cab28e3ee821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.559820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e6c4f294-e182-48d0-a3eb-cab28e3ee821 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:37.564559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6c4f294-e182-48d0-a3eb-cab28e3ee821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.582212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eee121-3a91-48c8-b9af-bcc76b402ab6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:37.593141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:37.594323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.595444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.595738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.600689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.711631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 911/1814] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:37.720288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.720779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.721205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.731916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:37.772708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:37.775482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.799070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 912/1815] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:37.807048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:37.835382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba920aa-ac4a-4b69-943a-a74b339494dd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:37.852177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:37.857549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.858349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.859421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.860721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:37.863656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:37.874794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:37.902294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:37.909377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:37.929170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 904/1816] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:37.939191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:37.939191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.939467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 913/1817] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:37.942600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:37.956245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2ab6e-ae4b-453f-b586-10f3e9a3ae29 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:37.963830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:37.964996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.965146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6970e0-fc5f-4ab5-86b5-d091f962a1ad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:37.965333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.965664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.967949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:37.980878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:37.981693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:37.981956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:37.982234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:37.984156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:37.988457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.000623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:38.007775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.052518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 905/1818] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:38.077020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 914/1819] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:37 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:38.082078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:38.109658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daebb80c-cf76-41c3-81ad-77c2f991bcac service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:38.276834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:38.346254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:38.347657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:38.348257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:38.351791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:38.356311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:38.361067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.422099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 906/1820] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:38 2022] POST /identity/v3/users => generated 284 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:38.427764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:38.457610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d4721-dccc-4ef7-8d86-c63297d244d6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:38.478139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:38.478993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:38.479269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:38.483996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:38.484832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:38.486877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.515625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 915/1821] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:38.517041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:38.531391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ce232c-a13f-4cfb-8815-86d2981f3e38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:38.549238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:38.549994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:38.550459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:38.550879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:38.551716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:38.556257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e856e7-c7e8-486e-9698-ee75268027f4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.606816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 907/1822] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:38.608092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:38.641162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c2118-e24f-4dc0-93bc-287eb55d6c57 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:38.656409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:38.669348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:38.669777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:38.673610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] PATH_INFO: `/v3/projects/64f0098f44b74264a17b692e70e06da2/users/e3d49a7b124743b190cad3a55ddcedbf/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:38.745479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f0098f44b74264a17b692e70e06da2, user_id=e3d49a7b124743b190cad3a55ddcedbf, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:38.764731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:38.812596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 916/1823] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:38 2022] PUT /identity/v3/projects/64f0098f44b74264a17b692e70e06da2/users/e3d49a7b124743b190cad3a55ddcedbf/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:38.825049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:38.825411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:38.825748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:38.921531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] MFA Rules not processed for user `e3d49a7b124743b190cad3a55ddcedbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:38.946509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:39.097404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 908/1824] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:39.102421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.202822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5afe4e-d608-43bf-898e-f6792043e427 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.207887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.208813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.209435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.209777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.210769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.214243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.218425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.266107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 917/1825] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:39 2022] POST /identity/v3/projects => generated 367 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:39.268956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.337651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4c7c2-1562-4b02-a72f-a3ce83e2e9a0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.399172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122dd64-4d3e-4460-a187-7a04ea56dac5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.410615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.411044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.413270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.413564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.414296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.418546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.462126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:39.474131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 918/1826] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:39 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:39.481366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.482976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:39.506144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa619a-e4ef-44a7-be27-f0679928f3b4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.519501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.520347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.521299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.521586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.522527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.524310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.532763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.533454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.533741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.534013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.556210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 919/1827] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:39.559000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.562764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.564571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.585117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c450c43-d7d6-4f30-a661-9c4e32013172 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.586741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 909/1828] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:39.602147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.603087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.603365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.603724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] PATH_INFO: `/v3/projects/3722b097332f4557a28807670f17f2fa/users/13c1e003697d4c42a27fd636520fdec7/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.636318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3722b097332f4557a28807670f17f2fa, user_id=13c1e003697d4c42a27fd636520fdec7, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.639155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.663162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 920/1829] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:39 2022] PUT /identity/v3/projects/3722b097332f4557a28807670f17f2fa/users/13c1e003697d4c42a27fd636520fdec7/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:39.666791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.680930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b67c12-b313-4ec5-a1c9-466ec1f0f477 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.779330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.780043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.780355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.781217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.781379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.783000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c00ae-9485-458a-a632-43ffb064ecde admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.795482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 910/1830] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:04:39.799400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.812537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ed9a1c-d549-46be-bdec-ada6b3eafbd2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:39.817486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:39.818395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.818677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.819092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] PATH_INFO: `/v3/projects/3722b097332f4557a28807670f17f2fa/users/13c1e003697d4c42a27fd636520fdec7/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.821233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3722b097332f4557a28807670f17f2fa, user_id=13c1e003697d4c42a27fd636520fdec7, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:39.823891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:39.844693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 921/1831] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:39 2022] PUT /identity/v3/projects/3722b097332f4557a28807670f17f2fa/users/13c1e003697d4c42a27fd636520fdec7/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:39.856518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:39.856802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:39.857075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:39.890500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] MFA Rules not processed for user `13c1e003697d4c42a27fd636520fdec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:39.892091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:39.979305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 911/1832] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:39.990358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:39.992286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:40.059277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:40.061531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:40.101881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e8ad53-8a4c-42e1-9438-3170ce5228c4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:40.124859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:40.126104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:40.126104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:40.126392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:40.154991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:40.157076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:40.159305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c144d7-e2f0-4a47-97c6-3377b7750b24 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:40.172508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 922/1833] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:40.182474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:40.183452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:40.193242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:40.195579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] PATH_INFO: `/v3/projects/3ad1027838cb4e7e90f585bc37235c7a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:40.197787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad1027838cb4e7e90f585bc37235c7a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:40.202592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:40.213307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:40.373432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad1027838cb4e7e90f585bc37235c7a', 'request_id': 'req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.390573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:40.390787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad1027838cb4e7e90f585bc37235c7a', 'request_id': 'req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.396407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:40.405335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad1027838cb4e7e90f585bc37235c7a', 'request_id': 'req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.439189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] The token cache is being invalidate because project 3ad1027838cb4e7e90f585bc37235c7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:40.439496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.440471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.442697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cdf0a-716e-42b4-967e-e8b5fc1f1de6 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:40.445678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 912/1834] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:40 2022] DELETE /identity/v3/projects/3ad1027838cb4e7e90f585bc37235c7a => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:40.447003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:40.448708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:40.610975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:40.611866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:40.619264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:40.619488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] PATH_INFO: `/v3/projects/404d88b1bac843689abf6785b6ef481a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:40.623143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] RBAC: Authorizing `identity:delete_project(project_id=404d88b1bac843689abf6785b6ef481a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:40.634235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb47c6-cea2-42a5-9fc7-c9596a60f927 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:40.635474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:40.650539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:40.651473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:40.651806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:40.652076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] PATH_INFO: `/v3/users/71ebc386153c4a50bc113b65acf9bd9b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:40.657286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ebc386153c4a50bc113b65acf9bd9b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:40.662076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:40.819183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404d88b1bac843689abf6785b6ef481a', 'request_id': 'req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.835056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404d88b1bac843689abf6785b6ef481a', 'request_id': 'req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.860252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:40.874238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404d88b1bac843689abf6785b6ef481a', 'request_id': 'req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.900401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] The token cache is being invalidate because project 404d88b1bac843689abf6785b6ef481a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:40.900762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.906246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.908369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 923/1835] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:40 2022] DELETE /identity/v3/projects/404d88b1bac843689abf6785b6ef481a => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:40.913035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:40.914462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:40.980500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ebc386153c4a50bc113b65acf9bd9b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.993013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ebc386153c4a50bc113b65acf9bd9b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.994513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ebc386153c4a50bc113b65acf9bd9b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:40.995733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ebc386153c4a50bc113b65acf9bd9b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.013292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ebc386153c4a50bc113b65acf9bd9b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.032640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 913/1836] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:40 2022] DELETE /identity/v3/users/71ebc386153c4a50bc113b65acf9bd9b => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:41.077616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46109-1cc6-48e0-a64e-bf18c8aa836c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:41.158601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:41.160658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:41.160979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:41.161357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] PATH_INFO: `/v3/users/d07b61aa55d64c45b0c1b6185d666dec` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:41.164009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d07b61aa55d64c45b0c1b6185d666dec)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:41.167464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:41.229175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd07b61aa55d64c45b0c1b6185d666dec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.240623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd07b61aa55d64c45b0c1b6185d666dec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.269666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd07b61aa55d64c45b0c1b6185d666dec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.277323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd07b61aa55d64c45b0c1b6185d666dec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.278049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c21736aa-3c88-4bb0-8136-ad8c5d16f8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd07b61aa55d64c45b0c1b6185d666dec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:41.315345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 924/1837] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:40 2022] DELETE /identity/v3/users/d07b61aa55d64c45b0c1b6185d666dec => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:42.102561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:42.105675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:42.126143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d597e-3f18-45a9-bca9-4dda28c9dc9d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:42.150066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:42.303904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:42.305084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.305415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.305739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] PATH_INFO: `/v3/projects/300cdf6769ce48e1a79f30998289e262` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.307014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=300cdf6769ce48e1a79f30998289e262)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:42.309090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:42.397994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '300cdf6769ce48e1a79f30998289e262', 'request_id': 'req-5c178325-6c0f-4c26-aea3-9a90157606b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.421148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '300cdf6769ce48e1a79f30998289e262', 'request_id': 'req-5c178325-6c0f-4c26-aea3-9a90157606b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.435128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '300cdf6769ce48e1a79f30998289e262', 'request_id': 'req-5c178325-6c0f-4c26-aea3-9a90157606b0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.459801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] The token cache is being invalidate because project 300cdf6769ce48e1a79f30998289e262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:42.460316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.461153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.464180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 914/1838] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:42 2022] DELETE /identity/v3/projects/300cdf6769ce48e1a79f30998289e262 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:42.470011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b7203-87c4-4803-8858-7e2429578031 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.470616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b7203-87c4-4803-8858-7e2429578031 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.470616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b7203-87c4-4803-8858-7e2429578031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.494713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-579b7203-87c4-4803-8858-7e2429578031 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:42.496224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-579b7203-87c4-4803-8858-7e2429578031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:42.520983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:42.526340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:42.530265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:42.596454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 925/1839] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:42.606602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.607272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.607690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.634477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:42.636862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:42.650194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 926/1840] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:42.652154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:42.666126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b82986-d40d-4ab2-8a8e-528b0930cf7e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:42.689219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c178325-6c0f-4c26-aea3-9a90157606b0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:42.696365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:42.697294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:42.698278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.698393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.698692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.699026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] PATH_INFO: `/v3/users/e3d49a7b124743b190cad3a55ddcedbf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.700452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3d49a7b124743b190cad3a55ddcedbf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:42.702485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:42.702623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.704741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.708601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:42.709439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:42.722807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:42.762560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 927/1841] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:04:42.764863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:42.791385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd667c-5a94-4346-9be8-1a0ab813784b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:42.819606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:42.822800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.824432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.824863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.829494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:42.832492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:42.841590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:42.882392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3d49a7b124743b190cad3a55ddcedbf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.895975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3d49a7b124743b190cad3a55ddcedbf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.897456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3d49a7b124743b190cad3a55ddcedbf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.898224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3d49a7b124743b190cad3a55ddcedbf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.907244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 928/1842] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:42 2022] POST /identity/v3/projects => generated 387 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:42.908577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:42.911688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:42.919042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81d77acc-fea9-41e4-afec-f5c07ef736c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3d49a7b124743b190cad3a55ddcedbf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:42.955272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 915/1843] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:42 2022] DELETE /identity/v3/users/e3d49a7b124743b190cad3a55ddcedbf => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:42.960865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:42.961328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:42.961650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:42.987539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:42.997964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.034898 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e60b24-605a-403f-a256-dda8554dc508 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.095061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 916/1844] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:43.096215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.098097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.119816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc954ab-ed2d-4e2c-b098-a28e0969f011 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.121688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.122460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.122738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.123017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.123740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.125855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.129423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.130822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.131283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.131738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] PATH_INFO: `/v3/projects/e321b1f3d67a42d7b64f10fc850463eb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.133572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e321b1f3d67a42d7b64f10fc850463eb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.135748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.164158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 929/1845] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:42 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:43.165301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.167111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.178805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:43.215219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e321b1f3d67a42d7b64f10fc850463eb', 'request_id': 'req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:43.225150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e321b1f3d67a42d7b64f10fc850463eb', 'request_id': 'req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:43.232195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e321b1f3d67a42d7b64f10fc850463eb', 'request_id': 'req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:43.250067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] The token cache is being invalidate because project e321b1f3d67a42d7b64f10fc850463eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:43.250410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:43.251174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:43.257004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 917/1846] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:43 2022] DELETE /identity/v3/projects/e321b1f3d67a42d7b64f10fc850463eb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:43.258260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.259762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.260723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fea463-e4df-4ef3-9e1d-2c6f1239bf0e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.324596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:43.339369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.340062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.340463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.340742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.352695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.358855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c23aa4c-0294-4fd6-b4ac-9a5003d8c0e2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.371476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.371676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.372682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.373132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.373425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b4b24-9fe1-4079-ba44-23158b494813 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.373877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.375343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.377551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.394017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 930/1847] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:43.395679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be714a-ce0f-41cf-ac7a-48f685a90583 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.395954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be714a-ce0f-41cf-ac7a-48f685a90583 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.396269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be714a-ce0f-41cf-ac7a-48f685a90583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.399376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 918/1848] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:43.401243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.416953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd8255-a5f2-476c-8438-f2f340b96b34 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.424636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.425426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.425887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.426150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.426976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.428834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.435306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0be714a-ce0f-41cf-ac7a-48f685a90583 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:43.438427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0be714a-ce0f-41cf-ac7a-48f685a90583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.448924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 919/1849] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:43.449394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 931/1850] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:43.452802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.457321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.457735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.458105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.468449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34481c-2ccc-4d37-ac46-09da81a21aec admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.477247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.480807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:43.482209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.485031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.485687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.486846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] PATH_INFO: `/v3/projects/d741aa8c59e247608ad1296f30636dbb/users/972d061a046d460ab68baf9b40046528/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.492807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 932/1851] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:43.496802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.509259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d741aa8c59e247608ad1296f30636dbb, user_id=972d061a046d460ab68baf9b40046528, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.513340 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0c716-51e8-4ccf-9066-1c4fed0c605a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.516257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06bf58-278a-472d-b84a-9755a088fe2e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.523792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.525168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.525821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.526217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.528281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:43.528742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.532666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.535293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 920/1852] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:43 2022] PUT /identity/v3/projects/d741aa8c59e247608ad1296f30636dbb/users/972d061a046d460ab68baf9b40046528/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:43.547329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.549476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.549476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.556866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 933/1853] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:04:43.558043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.572829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585396f-0296-4386-ad07-6f57acf44c5a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.589777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] MFA Rules not processed for user `972d061a046d460ab68baf9b40046528`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:43.591566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:43.684757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 921/1854] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:43.691979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.692722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.693026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.693299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.694195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.696388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.705557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.750652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a301089-fee8-4d31-80a2-ea74cf5c46d0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.751162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 934/1855] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:43.755469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.796411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:43.851650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dd4115-adcb-4312-9f97-bfef8302fa82 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.853476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.854172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.854447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.854715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.855426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.857056 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:43.857571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.857937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:43.858454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:43.859753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:43.860743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:43.863633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:43.898438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 922/1856] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/projects => generated 385 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:43.903276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.911626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 935/1857] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/users => generated 283 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:43.913030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:43.924329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b75f544-f459-47d7-a5e2-c831387bad29 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:43.954968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.008780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.009475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.009749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.010020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.010946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.012756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.017048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99adbba-de84-4637-918f-bf9620d22bb3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.022419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.023062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.023412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.023758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.024590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.026611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.026746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 936/1858] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:44.027921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.029706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.050265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175a26f8-1346-40ea-8d5e-5f13161b68f8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.063479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.063671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 923/1859] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:43 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:44.064140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.064337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.065047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.065803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] PATH_INFO: `/v3/projects/64f0098f44b74264a17b692e70e06da2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.067323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f0098f44b74264a17b692e70e06da2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.069442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.084821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e91533-d09d-4641-b514-6490afdbe348 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.098426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.101201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.102871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.104184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.104874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.110380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.136841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 924/1860] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:44.136841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.148954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383de7ff-eb48-474b-b540-bf0976f0cfa6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.155817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.157040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.157445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.158230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.160926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.162575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.185623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 925/1861] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:44.186656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.194324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f0098f44b74264a17b692e70e06da2', 'request_id': 'req-1e6dae99-aebf-4021-8aec-381cf4909b50'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.198379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ead602-a9e1-46c6-80a4-659b5313be5a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.208618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f0098f44b74264a17b692e70e06da2', 'request_id': 'req-1e6dae99-aebf-4021-8aec-381cf4909b50'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.231233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f0098f44b74264a17b692e70e06da2', 'request_id': 'req-1e6dae99-aebf-4021-8aec-381cf4909b50'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.244774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] The token cache is being invalidate because project 64f0098f44b74264a17b692e70e06da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:44.245128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.246054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.250634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 937/1862] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:44 2022] DELETE /identity/v3/projects/64f0098f44b74264a17b692e70e06da2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:44.250634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.251395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.273404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.274323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.274600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.274875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] PATH_INFO: `/v3/projects/027561ae53884276b5fd06c444fbfa26/users/514d8e9a6dc84e0588016dc21506de69/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.291163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=027561ae53884276b5fd06c444fbfa26, user_id=514d8e9a6dc84e0588016dc21506de69, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.291520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.294310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.323445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 926/1863] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:44 2022] PUT /identity/v3/projects/027561ae53884276b5fd06c444fbfa26/users/514d8e9a6dc84e0588016dc21506de69/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:44.324629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.327153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.329724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dae99-aebf-4021-8aec-381cf4909b50 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.401527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d4f55-9364-4902-ad74-43ee3dceb0c5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.406770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.407376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.407843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.408228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.408453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.408587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] PATH_INFO: `/v3/users/13c1e003697d4c42a27fd636520fdec7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.408739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.408991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] PATH_INFO: `/v3/projects/b856ac037db949e58f6e5748a0ed0f52/users/3216e25a0fdf41d58a933529e9366b03/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.410095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c1e003697d4c42a27fd636520fdec7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.412360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.427287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.429871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=b856ac037db949e58f6e5748a0ed0f52, user_id=3216e25a0fdf41d58a933529e9366b03, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.432779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b95e0-0993-4b0f-8eb7-9e0c93802dda admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.450391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 938/1864] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:44 2022] PUT /identity/v3/projects/b856ac037db949e58f6e5748a0ed0f52/users/3216e25a0fdf41d58a933529e9366b03/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:44.452014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.452332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.452604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.470458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c1e003697d4c42a27fd636520fdec7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.479466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c1e003697d4c42a27fd636520fdec7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.480178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c1e003697d4c42a27fd636520fdec7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.480878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c1e003697d4c42a27fd636520fdec7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.494775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c1e003697d4c42a27fd636520fdec7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.494925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] MFA Rules not processed for user `514d8e9a6dc84e0588016dc21506de69`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:44.496148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.510043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 927/1865] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:44 2022] DELETE /identity/v3/users/13c1e003697d4c42a27fd636520fdec7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:44.511126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.512533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.566347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 939/1866] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:44.571080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.572586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.597218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf148c-d323-49ea-9e07-e374ccf0d292 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.603819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.604778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.605129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.605411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.606168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.607787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.622259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 928/1867] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:44.626395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.637321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159986b5-4b48-43f8-ae10-ea1f87fb51d6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.638141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.642918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.643752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.644026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.644339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] PATH_INFO: `/v3/projects/b856ac037db949e58f6e5748a0ed0f52/users/3216e25a0fdf41d58a933529e9366b03/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.647252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b856ac037db949e58f6e5748a0ed0f52, user_id=3216e25a0fdf41d58a933529e9366b03, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.650232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f6d23-4a47-4519-acb4-45eaf555b5ef admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.654392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed9606-ac58-475d-b0fd-ac98da6cbf32 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.659358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.660018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.660391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.660665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.661364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.675560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 929/1868] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:44 2022] PUT /identity/v3/projects/b856ac037db949e58f6e5748a0ed0f52/users/3216e25a0fdf41d58a933529e9366b03/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:44.676065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.678584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.678923 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.679217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.712079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 940/1869] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:44 2022] POST /identity/v3/projects => generated 365 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:44.714158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] MFA Rules not processed for user `3216e25a0fdf41d58a933529e9366b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:44.715457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.716099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.786806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:44.792237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 930/1870] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:44.803664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.804501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a36f8-ff99-488b-97c6-cb6abd7bc386 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.811658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.812593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.813113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.813436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.813677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.814697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.817234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.864205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 941/1871] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:44 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:44.865613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.867835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:44.882088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e741c-9358-4f77-b8c5-bc636c35c58a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.887662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.888804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.889082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.889351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] PATH_INFO: `/v3/projects/3722b097332f4557a28807670f17f2fa` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.890783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3722b097332f4557a28807670f17f2fa)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.892513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.894620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9d4ac-5621-40fe-b372-991b428de206 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.898277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:44.898944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:44.899223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:44.899494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:44.912958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:44.914404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:44.925235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 931/1872] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:44.925905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:44.942893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d814c0fd-b5f9-473e-93d2-6914816b969e service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:44.952504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3722b097332f4557a28807670f17f2fa', 'request_id': 'req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.961466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3722b097332f4557a28807670f17f2fa', 'request_id': 'req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:44.979261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3722b097332f4557a28807670f17f2fa', 'request_id': 'req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:45.000347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] The token cache is being invalidate because project 3722b097332f4557a28807670f17f2fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:45.001048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:45.001825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-017946b4-7c82-4a41-8bd6-f1c68de5f9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:45.008721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 942/1873] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:44 2022] DELETE /identity/v3/projects/3722b097332f4557a28807670f17f2fa => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:45.010877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b43af-44e1-48f4-b030-7cd2648e15ea None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.011173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b43af-44e1-48f4-b030-7cd2648e15ea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.012253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b43af-44e1-48f4-b030-7cd2648e15ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.045098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8c1b43af-44e1-48f4-b030-7cd2648e15ea None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:45.046853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8c1b43af-44e1-48f4-b030-7cd2648e15ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.078735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.079477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.080063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.080357 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.084643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.086384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.099160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 932/1874] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:45.103344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.105128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.111974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:45.123536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026c90f-e866-4a2b-b387-9ad396afa0e9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.131114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.132880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.132880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.133077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] PATH_INFO: `/v3/projects/adf911fc65de4ff6aadfef67382b826c/users/bd092987c9c845ee83e6cac9d2b24a7f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.153855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf911fc65de4ff6aadfef67382b826c, user_id=bd092987c9c845ee83e6cac9d2b24a7f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.163331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 943/1875] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:45.165121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.165792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.166774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.180937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.189929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:45.192014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.207437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 933/1876] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:45 2022] PUT /identity/v3/projects/adf911fc65de4ff6aadfef67382b826c/users/bd092987c9c845ee83e6cac9d2b24a7f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:45.217155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.272195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 944/1877] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:45.276693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.287564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66feb6ee-40db-4d12-bb87-82cff7541723 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.293669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.294499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.294883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.295161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.295904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:45.296246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.297978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.304494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da03d-6a34-4abe-8f83-b19b2cc4b43e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.310180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.310929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.311118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.311494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.312111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.313724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 945/1878] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:45.316467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.317062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.327724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 934/1879] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:45.327863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd3899-192c-4f27-9b94-2039565f4c94 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.331764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.334440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.335630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.335922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.336229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.339064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.341386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.358421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a5be3-a431-46e0-924d-049020d0f9f8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.370952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.372152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.372556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.372972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] PATH_INFO: `/v3/projects/adf911fc65de4ff6aadfef67382b826c/users/bd092987c9c845ee83e6cac9d2b24a7f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.381085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=adf911fc65de4ff6aadfef67382b826c, user_id=bd092987c9c845ee83e6cac9d2b24a7f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.394004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c971cdb-86c3-4130-93f4-1b35c458eb1b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.397907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:45.412199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 935/1880] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:45 2022] PUT /identity/v3/projects/adf911fc65de4ff6aadfef67382b826c/users/bd092987c9c845ee83e6cac9d2b24a7f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:45.424933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.426590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.427376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.433698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 946/1881] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:45.437912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.499754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] MFA Rules not processed for user `bd092987c9c845ee83e6cac9d2b24a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:45.501226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.563826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ee75e-5e51-4c47-a93f-d09cac567f66 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.579136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.587534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.587534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.587534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.587534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.587534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.630939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 947/1882] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:45.637305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.650669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 936/1883] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:45.661353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee857c-2b66-41ff-b0cb-3994e279091c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.669181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.669856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.672773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.676573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.676899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.677989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.678826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.683755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.717137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 948/1884] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:45.720684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.739566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b2120f-9f4d-48c2-9acc-39cd93396807 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.752310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.754960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.755257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.755534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.757296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.760177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.772869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731a30ee-6aa2-4ced-8a5f-7b430f8612cf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.779251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 949/1885] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:45 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:04:45.784617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.790137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.793795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.794173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.794619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.795505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aab0c2-cf7b-4fe1-bd9a-f2b14892e79e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.813199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.814328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.814532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.816680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] PATH_INFO: `/v3/projects/2e9b114b04a140069aacd738670e69aa/users/d800d2006ff44bf0883a97ee493e75af/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.834264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.835841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.839000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9b114b04a140069aacd738670e69aa, user_id=d800d2006ff44bf0883a97ee493e75af, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.842317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a10403-964b-4a50-ac0f-08bc34712732 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.861192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 937/1886] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:45 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:45.861676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:45.862200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:45.864070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:45.877998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 950/1887] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:45 2022] PUT /identity/v3/projects/2e9b114b04a140069aacd738670e69aa/users/d800d2006ff44bf0883a97ee493e75af/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:45.888547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28a87-fd55-4cf8-9495-7d16f1c93360 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.888832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28a87-fd55-4cf8-9495-7d16f1c93360 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.889110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e28a87-fd55-4cf8-9495-7d16f1c93360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.896927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8788de6-5748-4b0a-8733-42a95bcd641a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:45.975922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:45.977022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:45.977396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:45.977770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] PATH_INFO: `/v3/users/972d061a046d460ab68baf9b40046528` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:45.979462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=972d061a046d460ab68baf9b40046528)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:45.981948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:45.985266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-31e28a87-fd55-4cf8-9495-7d16f1c93360 None None] MFA Rules not processed for user `d800d2006ff44bf0883a97ee493e75af`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:45.986550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-31e28a87-fd55-4cf8-9495-7d16f1c93360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.045608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:46.101754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '972d061a046d460ab68baf9b40046528'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.112090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '972d061a046d460ab68baf9b40046528'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.117247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '972d061a046d460ab68baf9b40046528'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.118304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '972d061a046d460ab68baf9b40046528'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.132550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '972d061a046d460ab68baf9b40046528'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.155881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 938/1889] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:45 2022] DELETE /identity/v3/users/972d061a046d460ab68baf9b40046528 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:46.156473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 951/1889] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:46.160112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.160979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954398-7fea-4286-a5df-b288d47db497 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.161834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.162288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954398-7fea-4286-a5df-b288d47db497 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.162708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94954398-7fea-4286-a5df-b288d47db497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.215928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-94954398-7fea-4286-a5df-b288d47db497 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:46.218421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-94954398-7fea-4286-a5df-b288d47db497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.287119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc655a-31d9-4c80-8908-2809bbf26171 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.308610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.312506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.313950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.314406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.320133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.323218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.350439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 952/1890] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:46.367133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94954398-7fea-4286-a5df-b288d47db497 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.371716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-94954398-7fea-4286-a5df-b288d47db497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.398135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 939/1891] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:46 2022] POST /identity/v3/projects => generated 377 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:46.402342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.504920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94954398-7fea-4286-a5df-b288d47db497 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.554104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646817-c6e1-4488-ba4e-37b3a6a8fc54 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.562158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.563612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.564017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.564404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.565828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.575742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:46.577415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.583452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.585084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.585084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.585084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.600285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.602408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.603175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 940/1892] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:46 2022] POST /identity/v3/users => generated 295 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:46.604214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.605993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.616534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 953/1893] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:46.617697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.626546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4589eadc-d2ad-47e5-912b-ed77fe2d72aa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.628355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738979ea-40b3-43e0-a4da-5e5a481bfdd3 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.633751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.634444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.635234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.636096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.636096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.636373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.636853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.637357 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.637683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] PATH_INFO: `/v3/users/514d8e9a6dc84e0588016dc21506de69` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.639197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.639592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] RBAC: Authorizing `identity:delete_user(user_id=514d8e9a6dc84e0588016dc21506de69)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.641724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.655397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 954/1894] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:46.659991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.675132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15f6cf-ee88-45e7-98f0-1516cec1b548 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.681296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.682851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.682954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.683336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] PATH_INFO: `/v3/projects/fd2e0926778747809c5d03f1b4011919/users/afb57dc926a847d39421223224ab066b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.693113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:46.708587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2e0926778747809c5d03f1b4011919, user_id=afb57dc926a847d39421223224ab066b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.712479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.731414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 955/1895] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:46 2022] PUT /identity/v3/projects/fd2e0926778747809c5d03f1b4011919/users/afb57dc926a847d39421223224ab066b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:46.737609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.798221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514d8e9a6dc84e0588016dc21506de69'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.825985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514d8e9a6dc84e0588016dc21506de69'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.828554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514d8e9a6dc84e0588016dc21506de69'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.830784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514d8e9a6dc84e0588016dc21506de69'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.866047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8c589024-5cb5-4bf9-af54-cda368bc574b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514d8e9a6dc84e0588016dc21506de69'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:46.887967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d13fa-b53b-4635-986a-1bc0f55043cd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.895575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:46.896552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.898895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.899285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.903081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:46.910273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:46.921715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 941/1896] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:46 2022] DELETE /identity/v3/users/514d8e9a6dc84e0588016dc21506de69 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:46.927991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:46.929073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:46.930290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:46.933939 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 956/1897] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:04:46.939760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:46.946757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:46.971978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef63c4-cc29-4e9b-8cd9-0edbbb84ddfc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:46.983254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:46.991631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.095505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 942/1898] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:47.110234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:47.112589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.146719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:47.150397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.151640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.151918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] PATH_INFO: `/v3/projects/fd2e0926778747809c5d03f1b4011919/users/afb57dc926a847d39421223224ab066b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.159996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2e0926778747809c5d03f1b4011919, user_id=afb57dc926a847d39421223224ab066b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:47.170344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:47.211890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 957/1899] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:46 2022] PUT /identity/v3/projects/fd2e0926778747809c5d03f1b4011919/users/afb57dc926a847d39421223224ab066b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:47.217115 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:47.229187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.259447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951a943c-38a1-47fb-a87c-a0eabe6064ea None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:47.328257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:47.356502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:47.359237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4ad8b-fba5-4b0f-8ee3-6b3227a88dea admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:47.363509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:47.364514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.364977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.365325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.370531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:47.371609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.371891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.372205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] PATH_INFO: `/v3/projects/d741aa8c59e247608ad1296f30636dbb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.375750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d741aa8c59e247608ad1296f30636dbb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:47.377612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:47.377762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:47.380333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248c588-afbd-443c-8bce-e3766ed9aaab service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:47.391861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 943/1900] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:47.393591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.394028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.394415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.423745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] MFA Rules not processed for user `afb57dc926a847d39421223224ab066b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:47.425302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.486238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd741aa8c59e247608ad1296f30636dbb', 'request_id': 'req-bd57f847-e6d2-4124-b5be-ac57b1dbe516'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.497796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd741aa8c59e247608ad1296f30636dbb', 'request_id': 'req-bd57f847-e6d2-4124-b5be-ac57b1dbe516'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.513489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd741aa8c59e247608ad1296f30636dbb', 'request_id': 'req-bd57f847-e6d2-4124-b5be-ac57b1dbe516'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.533599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] The token cache is being invalidate because project d741aa8c59e247608ad1296f30636dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:47.534062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.535257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.537539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 958/1901] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:47 2022] DELETE /identity/v3/projects/d741aa8c59e247608ad1296f30636dbb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:47.541922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:47.543717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.584734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 944/1902] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:47.603244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:47.606156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.685168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57f847-e6d2-4124-b5be-ac57b1dbe516 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:47.689905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:47.690800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.691074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.691341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] PATH_INFO: `/v3/users/3216e25a0fdf41d58a933529e9366b03` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.692785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3216e25a0fdf41d58a933529e9366b03)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:47.694709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:47.714982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89fc6-06a8-46cf-a558-569d60bb7b80 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:47.755271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3216e25a0fdf41d58a933529e9366b03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.764831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3216e25a0fdf41d58a933529e9366b03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.777467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:47.778145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:47.778423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:47.778765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:47.780370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3216e25a0fdf41d58a933529e9366b03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.780609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.781256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3216e25a0fdf41d58a933529e9366b03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.781964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3216e25a0fdf41d58a933529e9366b03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:47.788964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:47.804213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 959/1903] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:47 2022] DELETE /identity/v3/users/3216e25a0fdf41d58a933529e9366b03 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:47.837142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:47.879250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:47.879867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:47.880705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:47.881399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:47.891125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 945/1904] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:47.998924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48c250-dd66-4b67-9c63-2bc7e417ddc6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.006102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.007155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.007535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.007887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] PATH_INFO: `/v3/projects/027561ae53884276b5fd06c444fbfa26` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.009239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=027561ae53884276b5fd06c444fbfa26)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.011320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.107372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '027561ae53884276b5fd06c444fbfa26', 'request_id': 'req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.116938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '027561ae53884276b5fd06c444fbfa26', 'request_id': 'req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.127571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '027561ae53884276b5fd06c444fbfa26', 'request_id': 'req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.141855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] The token cache is being invalidate because project 027561ae53884276b5fd06c444fbfa26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:48.142263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.143038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.148226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 960/1905] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:47 2022] DELETE /identity/v3/projects/027561ae53884276b5fd06c444fbfa26 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:48.149467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.151442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:48.171316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca9354-d7a2-4a59-8ec2-ab41fef9430e service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.231285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.233224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:48.269978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.271038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.271407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.271925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] PATH_INFO: `/v3/users/bd092987c9c845ee83e6cac9d2b24a7f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.274343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd092987c9c845ee83e6cac9d2b24a7f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.276758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.350316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8bfef-55d2-4f7d-9fad-e2cfb956ca15 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.358818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.360826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.361231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd092987c9c845ee83e6cac9d2b24a7f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.361642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.362408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] PATH_INFO: `/v3/projects/b856ac037db949e58f6e5748a0ed0f52` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.365081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b856ac037db949e58f6e5748a0ed0f52)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.368423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.371376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd092987c9c845ee83e6cac9d2b24a7f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.372329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd092987c9c845ee83e6cac9d2b24a7f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.373157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd092987c9c845ee83e6cac9d2b24a7f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.389764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a81b5e11-618c-4c89-99c7-ef5ccf87f6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd092987c9c845ee83e6cac9d2b24a7f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.404592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 946/1906] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:04:48 2022] DELETE /identity/v3/users/bd092987c9c845ee83e6cac9d2b24a7f => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:48.412133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:48.432593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b856ac037db949e58f6e5748a0ed0f52', 'request_id': 'req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.440086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b856ac037db949e58f6e5748a0ed0f52', 'request_id': 'req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.450965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b856ac037db949e58f6e5748a0ed0f52', 'request_id': 'req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.478956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] The token cache is being invalidate because project b856ac037db949e58f6e5748a0ed0f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:48.479739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.481127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8497c4a8-ae34-4a67-96e6-c2634ca25c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.483156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 961/1907] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:48 2022] DELETE /identity/v3/projects/b856ac037db949e58f6e5748a0ed0f52 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:48.488582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.488883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.489505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.509733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:48.510972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:48.590952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 947/1908] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:48.598612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.598923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.599385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.624895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:48.626318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:48.642639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 962/1909] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:48.647103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.654561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:48.659334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b19a76-3c05-4f75-abe9-8a8a7aff65eb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.666304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.667396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.667684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.668318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.670150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:48.670836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.672633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.707381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 948/1910] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:48.712376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.723905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445d450-b025-4a51-a97c-8a468c224366 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.733283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.736825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.739905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:48.748449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.749580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.750586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.752912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.755294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.772805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2de11-b50c-404a-9c13-e68c0385a398 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:48.784895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:48.786088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.787220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.787602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] PATH_INFO: `/v3/projects/adf911fc65de4ff6aadfef67382b826c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.789224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] RBAC: Authorizing `identity:delete_project(project_id=adf911fc65de4ff6aadfef67382b826c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:48.793970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:48.818042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 963/1911] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:48 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:48.822427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:48.901532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adf911fc65de4ff6aadfef67382b826c', 'request_id': 'req-23009c15-04e2-41d0-b327-4a567ae8467a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.914666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adf911fc65de4ff6aadfef67382b826c', 'request_id': 'req-23009c15-04e2-41d0-b327-4a567ae8467a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.927098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adf911fc65de4ff6aadfef67382b826c', 'request_id': 'req-23009c15-04e2-41d0-b327-4a567ae8467a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.953429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] The token cache is being invalidate because project adf911fc65de4ff6aadfef67382b826c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:04:48.953724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.960688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-23009c15-04e2-41d0-b327-4a567ae8467a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:04:48.967905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 949/1912] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:04:48 2022] DELETE /identity/v3/projects/adf911fc65de4ff6aadfef67382b826c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:48.970089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dcc5-157e-4b69-9db9-d179eccdb106 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:48.973135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dcc5-157e-4b69-9db9-d179eccdb106 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:48.973438 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3dcc5-157e-4b69-9db9-d179eccdb106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:48.979687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea5e05-4f7a-4447-9895-050217baf4d5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.016547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e9c3dcc5-157e-4b69-9db9-d179eccdb106 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:49.017787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e9c3dcc5-157e-4b69-9db9-d179eccdb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:49.110668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.111309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.111468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.111685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.113839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.116188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.131676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 950/1913] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:49.140962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.141563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.142146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.153053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 964/1914] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:48 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:49.157394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.159751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:49.177972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:49.180454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:49.185316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb7434-03e0-4281-bd9d-a3fc84717a49 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.191146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.191687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 951/1915] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:49.192088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.192411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.192789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.193560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.195124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.205542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4a231-c319-413c-9890-7be76fb08f58 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.207969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.212157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.213093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.213739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.214195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.215110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:04:49.215812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.217826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.223742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 965/1916] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:49.227551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.235288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 952/1917] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:04:49.240435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1a7db-bf45-424b-b80b-75428392082c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.241356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.245628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.246312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.246623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.246902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.247635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.249447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.255429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f547af7-1133-48a2-afb4-2b9ec329dd0f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.255765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:49.260955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.261860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.262334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.262778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.263815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.267118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.269178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 966/1918] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:04:49.271230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.282370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472943c-1b05-4daa-a966-124c4e0d1ea9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.287344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.288431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.288594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.288937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] PATH_INFO: `/v3/projects/8a474a2d4dad455483d8d82b5687ea9d/users/28424422f1c743c5bb88035818834add/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.305362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 953/1919] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/projects => generated 355 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:49.307036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a474a2d4dad455483d8d82b5687ea9d, user_id=28424422f1c743c5bb88035818834add, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.310417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1ab94-b86c-4ad8-b187-a5086b3b547b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.313171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.338566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 967/1920] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:49 2022] PUT /identity/v3/projects/8a474a2d4dad455483d8d82b5687ea9d/users/28424422f1c743c5bb88035818834add/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:49.354352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.354905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.356647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.370607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:49.411812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] MFA Rules not processed for user `28424422f1c743c5bb88035818834add`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:49.413239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:49.428219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb72e4d-00be-44d3-99cf-6a0fd6dfa90b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.501767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 968/1921] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:49.507028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.528907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.529783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.530194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.530584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.531599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.534661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.565447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 954/1922] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/users => generated 278 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:49.570074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.581506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5271e37d-694e-4d85-b426-0fbe2c710d0d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.591098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.592341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.592781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.593114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.595217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.599216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.622599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 955/1923] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:49.631540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.633710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a22007-26ad-457b-ab8c-e29f41d6d82b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.648961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.649831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.650193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.650520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8967dc2-ab8e-4066-9da8-2ef588310ee2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.650703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.651669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.653710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.663254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.663632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.663909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.664529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.665279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.667103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.680939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 956/1924] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:49.684963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.697441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23f7fd-542f-452f-bcd2-819f5020e61e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.702705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.703815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.704248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.704521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] PATH_INFO: `/v3/projects/c540911dfdaf44bb8d7273958d35633c/users/6c6a2c51054a4eaeac0d2c6ae0902489/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.707819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 969/1925] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:49.709436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.732059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c540911dfdaf44bb8d7273958d35633c, user_id=6c6a2c51054a4eaeac0d2c6ae0902489, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.736308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b25bb9-adc2-4f0c-a36f-b741a551461d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.757144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 957/1926] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:49 2022] PUT /identity/v3/projects/c540911dfdaf44bb8d7273958d35633c/users/6c6a2c51054a4eaeac0d2c6ae0902489/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:49.768501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.768818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.769149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.779558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:49.793098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16bd1a-0ead-4621-b006-76f3cc518d90 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.796649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] MFA Rules not processed for user `6c6a2c51054a4eaeac0d2c6ae0902489`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:49.797945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:49.860769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.861756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.862637 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.862637 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.863589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.865761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.871615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 958/1927] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:49.876853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.889533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e99909-02dd-41a6-ae93-37b6294f4f55 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.892486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 970/1928] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:49.895017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.895792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.895992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.896294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.896697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.897087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.899844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.907591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6710b77-1ef7-407d-90eb-0de1694bae76 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:49.912385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:49.912836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:49.913821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:49.914390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:49.914776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:49.915610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:49.917353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:49.930454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 971/1929] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:04:49.933893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 959/1930] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/projects => generated 357 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:04:49.945099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.947470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:49.950045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a429b93-f1c5-45ee-b4b4-64045dfab178 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.011661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.013780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.013780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.013780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] PATH_INFO: `/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06/users/c490dffc20a74c9987b15e503c60caad/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.014386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47880eb4-8158-400d-9335-727774cee33d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.024593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.025661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.025977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.026253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.027055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.029300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.030853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b72c0533b84d74acfdf67f4a3d5e06, user_id=c490dffc20a74c9987b15e503c60caad, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.033670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.055435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 972/1931] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:49 2022] PUT /identity/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06/users/c490dffc20a74c9987b15e503c60caad/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:50.057067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.069125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 960/1932] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:04:49 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:04:50.069729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.080960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ad923-d120-4356-a47d-e1064d967578 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.134513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39025e6e-4e41-4572-af81-3e702a75af41 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.140602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.141491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.141931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.142214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.142994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.144726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.146771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.156670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.157512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.157886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 973/1933] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:50.158321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.158734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.159577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.161507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.162252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.173052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb6fe5-5865-4ff8-bada-22b4d13b7f2a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.174428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 961/1934] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:50.178176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.180878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.181993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.182342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.182776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] PATH_INFO: `/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06/users/c490dffc20a74c9987b15e503c60caad/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.185437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b72c0533b84d74acfdf67f4a3d5e06, user_id=c490dffc20a74c9987b15e503c60caad, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.188336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca79f82-bbb3-48c9-92ea-d9c8dcf8c55e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.188801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a161aa0-26f6-4542-9fb9-58e01a40c9db admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.193861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.194855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.195228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.195573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] PATH_INFO: `/v3/projects/448b841d75974352b8774cff11d988b9/users/4ccc8209e28645fdb5a0bbe972ae0622/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.201178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 974/1935] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:50 2022] PUT /identity/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06/users/c490dffc20a74c9987b15e503c60caad/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:50.218377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.218377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.218377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.218721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b841d75974352b8774cff11d988b9, user_id=4ccc8209e28645fdb5a0bbe972ae0622, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.218721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.235089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 962/1936] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:50 2022] PUT /identity/v3/projects/448b841d75974352b8774cff11d988b9/users/4ccc8209e28645fdb5a0bbe972ae0622/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:04:50.237059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.244631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] MFA Rules not processed for user `c490dffc20a74c9987b15e503c60caad`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:50.245896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:50.292707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.304201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4084d-d9fa-40fa-8a50-204b8262b3de admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.308799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.309468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.309744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.310013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.310740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.312386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.322989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 975/1937] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:50.323448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 963/1938] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:04:50.329332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.337648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.339545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:50.340317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b201f7a-9683-4091-9fab-f00268a99247 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.344962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.345856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.346271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.346551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] PATH_INFO: `/v3/projects/448b841d75974352b8774cff11d988b9/users/4ccc8209e28645fdb5a0bbe972ae0622/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.349182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448b841d75974352b8774cff11d988b9, user_id=4ccc8209e28645fdb5a0bbe972ae0622, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.353288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4fa903-3096-40d3-a3bf-084345c59cf4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.363842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 976/1939] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:04:50 2022] PUT /identity/v3/projects/448b841d75974352b8774cff11d988b9/users/4ccc8209e28645fdb5a0bbe972ae0622/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:04:50.374244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.374536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.374843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.400575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae53353-e1be-4d42-b6e4-90abfb749cb6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.404349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] MFA Rules not processed for user `4ccc8209e28645fdb5a0bbe972ae0622`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:50.405565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:50.458582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.459779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.460156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.460487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.483693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 977/1940] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:04:50 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:04:50.496534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.498272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:50.511228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820c57a-7ed3-4cda-b1e2-fe7379e10464 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.520039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.521171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.521451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.522209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.534072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.537680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.540470 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.541994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.554025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 964/1941] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:50.562735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 978/1942] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:04:50.666951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.683893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b264d99-754f-4839-b678-64ac5fc217ac service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.687765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.688608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.688885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.689158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.770761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:50.772725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb8116-fe8d-4464-a54c-2bca08034e72 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:50.777435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:50.786843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 965/1943] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:50.967116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:50.984720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c499a-8e70-4863-be48-cd41b98ab123 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:50.991201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:50.991986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:50.992398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:50.992770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:50.995263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:51.054926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:04:51.095414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368b95-cf94-418f-ae58-11a63a1896e8 None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:51.096316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368b95-cf94-418f-ae58-11a63a1896e8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:51.096775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10368b95-cf94-418f-ae58-11a63a1896e8 None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:51.100466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:51.100979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 966/1944] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:04:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:04:51.102074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:51.113986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 979/1945] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:51.124618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:51.125129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:51.125575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:51.162685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:04:51.164502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:51.298839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 967/1946] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:04:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:04:51.521427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:51.522972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:04:51.539864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c897c-eb25-487e-a84f-b19de2172b76 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:51.545803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:51.546577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:51.546867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:51.547137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:51.556968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:51.558642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:51.569142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 980/1947] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:04:54.985840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:04:54.995900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bdf7e4-146c-47aa-b2f8-ad0d7f91b63b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:04:54.999600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:04:55.000296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:04:55.000589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:04:55.000837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:04:55.084967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:04:55.086660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e2d49-75b8-4e1e-b441-815debb7e50c service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:04:55.113532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 968/1948] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:04:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:00.521116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:00.588197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63a0d8-9b42-4b77-8bcb-4827f4ae8164 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:00.593048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:00.594008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:00.594286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:00.594559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] PATH_INFO: `/v3/users/28424422f1c743c5bb88035818834add` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:00.595973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] RBAC: Authorizing `identity:delete_user(user_id=28424422f1c743c5bb88035818834add)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:00.598114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:00.657082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28424422f1c743c5bb88035818834add'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:00.666581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28424422f1c743c5bb88035818834add'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:00.683218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28424422f1c743c5bb88035818834add'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:00.684197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28424422f1c743c5bb88035818834add'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:00.685136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28424422f1c743c5bb88035818834add'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:00.701212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 981/1949] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:00 2022] DELETE /identity/v3/users/28424422f1c743c5bb88035818834add => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:00.705420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:00.705922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:00.706102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:00.726640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:00.728384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:00.824296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 969/1950] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:00.835308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:00.837487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:00.887446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:00.919940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af54f9e-8ed4-4b38-a2c1-c3f4d8e0163c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:00.923871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:00.924566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:00.924844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:00.925117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:00.938905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:00.940758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:00.952269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 982/1951] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:01.409591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:01.411043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:01.423956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c507f3-987f-48e5-9f63-4c8b30a4df3d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:01.428953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:01.430012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:01.430276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:01.430605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] PATH_INFO: `/v3/projects/8a474a2d4dad455483d8d82b5687ea9d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:01.431956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a474a2d4dad455483d8d82b5687ea9d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:01.434166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:01.471074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:01.497060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a474a2d4dad455483d8d82b5687ea9d', 'request_id': 'req-2d119e3b-f547-483e-a4e6-70771f8c0395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.506375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a474a2d4dad455483d8d82b5687ea9d', 'request_id': 'req-2d119e3b-f547-483e-a4e6-70771f8c0395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.512450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a474a2d4dad455483d8d82b5687ea9d', 'request_id': 'req-2d119e3b-f547-483e-a4e6-70771f8c0395'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.525032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] The token cache is being invalidate because project 8a474a2d4dad455483d8d82b5687ea9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:01.525317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.525943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.527765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 970/1952] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:01 2022] DELETE /identity/v3/projects/8a474a2d4dad455483d8d82b5687ea9d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:01.531729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:01.542587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea91789-3324-4ce2-9a19-ca911d5e51cd service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:01.605559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:01.606544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:01.606817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:01.607084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] PATH_INFO: `/v3/users/c490dffc20a74c9987b15e503c60caad` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:01.608491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c490dffc20a74c9987b15e503c60caad)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:01.610463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:01.664402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c490dffc20a74c9987b15e503c60caad'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.672657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c490dffc20a74c9987b15e503c60caad'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.685859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c490dffc20a74c9987b15e503c60caad'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.686618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c490dffc20a74c9987b15e503c60caad'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.687398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-918009a9-cb22-4fc5-a44c-4cfa0ce7852b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c490dffc20a74c9987b15e503c60caad'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:01.703589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 983/1953] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:01 2022] DELETE /identity/v3/users/c490dffc20a74c9987b15e503c60caad => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:02.044086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.045620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:02.067345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d119e3b-f547-483e-a4e6-70771f8c0395 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.138655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.140707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.140969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.141247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] PATH_INFO: `/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.143363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b72c0533b84d74acfdf67f4a3d5e06)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.145454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.200382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b72c0533b84d74acfdf67f4a3d5e06', 'request_id': 'req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:02.209936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b72c0533b84d74acfdf67f4a3d5e06', 'request_id': 'req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:02.218729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b72c0533b84d74acfdf67f4a3d5e06', 'request_id': 'req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:02.237046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] The token cache is being invalidate because project f3b72c0533b84d74acfdf67f4a3d5e06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:02.237046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:02.237046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2f044b43-e646-4d7f-8e3d-4b4a9c60065e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:02.237528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 971/1954] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:02 2022] DELETE /identity/v3/projects/f3b72c0533b84d74acfdf67f4a3d5e06 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:02.243450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.243856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.244275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.266641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:02.268053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:02.323496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:02.355698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 984/1955] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:02.364485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.365228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.365413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.387536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:02.388719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:02.407045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 972/1956] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:02.411125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.420949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f727d-a390-4d2b-ad2b-d4ee1ea3a5aa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.425718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.426410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.426694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.426970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.427767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:02.428078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.429727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.441905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 985/1957] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:02.446255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.455702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76793-418d-4d58-b46a-6020231292a2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.460780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.461446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.461722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.462049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.462776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.464723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.490444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 973/1958] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:02 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:02.494779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.504684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4db62-c35f-4d53-b754-64b9ff245ee1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.566887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.567527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.567822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.568090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.568804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.570733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.592495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 986/1959] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:02 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:02.596878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.608178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e39fa6-0f1b-4ad2-9831-e661861926c3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.613247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.613918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.614192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.614460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.615237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.616892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.619006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:02.632231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 974/1960] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:02.636714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.651058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3494b21-e948-4917-967d-63fffdf66616 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.656632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.657365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.657646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.657937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.658700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.660351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1511929-f6aa-4a88-8338-b9fdfd1fc884 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.671092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 987/1961] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:02.675463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.686018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01977e22-814f-4987-b599-1f86a6f76804 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.691093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf793-2449-483a-9195-94853c978229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.691976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf793-2449-483a-9195-94853c978229 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.692281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf793-2449-483a-9195-94853c978229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.692546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35daf793-2449-483a-9195-94853c978229 admin admin] PATH_INFO: `/v3/projects/e112312d1baf4b8c93d31da59033a26d/users/bf7b316f86924d9ebfa63612e54c7888/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.707282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daf793-2449-483a-9195-94853c978229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e112312d1baf4b8c93d31da59033a26d, user_id=bf7b316f86924d9ebfa63612e54c7888, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.710279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35daf793-2449-483a-9195-94853c978229 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.726521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 975/1962] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:02 2022] PUT /identity/v3/projects/e112312d1baf4b8c93d31da59033a26d/users/bf7b316f86924d9ebfa63612e54c7888/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:02.739697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.740021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.740323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.770495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] MFA Rules not processed for user `bf7b316f86924d9ebfa63612e54c7888`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:02.771731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:02.846632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 988/1963] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:02.860476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf793-2449-483a-9195-94853c978229 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:02.862608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-35daf793-2449-483a-9195-94853c978229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:02.926454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35daf793-2449-483a-9195-94853c978229 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:02.932053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:02.932821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:02.933102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:02.933376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:02.943324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:02.944817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40632a2a-afdd-4e25-b9a4-5ca59db3953c service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:02.954400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 976/1964] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:04.601907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:04.603572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:04.667488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:04.687795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cd1f8-5c08-4122-8084-b67bca399042 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:04.694936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:04.695937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:04.696264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:04.696607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] PATH_INFO: `/v3/users/d800d2006ff44bf0883a97ee493e75af` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:04.697982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d800d2006ff44bf0883a97ee493e75af)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:04.700049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:04.759805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd800d2006ff44bf0883a97ee493e75af'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:04.768857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd800d2006ff44bf0883a97ee493e75af'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:04.785168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd800d2006ff44bf0883a97ee493e75af'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:04.785801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd800d2006ff44bf0883a97ee493e75af'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:04.786406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd800d2006ff44bf0883a97ee493e75af'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:04.801473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 989/1965] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:04 2022] DELETE /identity/v3/users/d800d2006ff44bf0883a97ee493e75af => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:04.806613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:04.807058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:04.807528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:04.827892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:04.834256 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:04.934080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 977/1966] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:04.973919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:04.975454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:05.033469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0110be20-5a0f-42f6-a661-cd3d7dc44cd3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:05.037363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:05.037955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:05.038259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:05.038521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:05.049985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:05.051547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:05.062828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 990/1967] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:05.457431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:05.459253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:05.491673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418215e-7532-4ac4-bde3-6b49c707a6e0 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:05.499284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:05.503721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:05.504436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:05.505016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] PATH_INFO: `/v3/projects/2e9b114b04a140069aacd738670e69aa` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:05.509100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9b114b04a140069aacd738670e69aa)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:05.516514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:05.619334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9b114b04a140069aacd738670e69aa', 'request_id': 'req-c8538870-efcf-4a62-bb40-078fc017a1cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.634154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9b114b04a140069aacd738670e69aa', 'request_id': 'req-c8538870-efcf-4a62-bb40-078fc017a1cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.643001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9b114b04a140069aacd738670e69aa', 'request_id': 'req-c8538870-efcf-4a62-bb40-078fc017a1cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.663157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:05.669822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] The token cache is being invalidate because project 2e9b114b04a140069aacd738670e69aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:05.670384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.671642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.675729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 978/1968] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:05 2022] DELETE /identity/v3/projects/2e9b114b04a140069aacd738670e69aa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:05.679579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:05.689776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1c5d3-7b33-4ad1-ba43-09fb13b58c5a service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:05.763354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:05.764900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:05.765188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:05.765463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] PATH_INFO: `/v3/users/afb57dc926a847d39421223224ab066b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:05.767034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb57dc926a847d39421223224ab066b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:05.769608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:05.789082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:05.845310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb57dc926a847d39421223224ab066b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.853029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb57dc926a847d39421223224ab066b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.864881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb57dc926a847d39421223224ab066b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.865556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb57dc926a847d39421223224ab066b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.866227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb57dc926a847d39421223224ab066b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:05.878499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 991/1969] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:05 2022] DELETE /identity/v3/users/afb57dc926a847d39421223224ab066b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:06.249069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.251126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.271297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8538870-efcf-4a62-bb40-078fc017a1cc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:06.428695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:06.429621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.429900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.430320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] PATH_INFO: `/v3/projects/fd2e0926778747809c5d03f1b4011919` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.431612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2e0926778747809c5d03f1b4011919)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:06.433783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:06.449575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.451297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.474225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5635c2e-ec5d-4adb-ba67-9bccbd4276a6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:06.480242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:06.481152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.481433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.481709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] PATH_INFO: `/v3/users/6c6a2c51054a4eaeac0d2c6ae0902489` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.483263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6a2c51054a4eaeac0d2c6ae0902489)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:06.485863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:06.517911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2e0926778747809c5d03f1b4011919', 'request_id': 'req-2584252d-53b3-4335-99d0-1dc17ec26ab9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.535040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2e0926778747809c5d03f1b4011919', 'request_id': 'req-2584252d-53b3-4335-99d0-1dc17ec26ab9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.551838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2e0926778747809c5d03f1b4011919', 'request_id': 'req-2584252d-53b3-4335-99d0-1dc17ec26ab9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.569157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6a2c51054a4eaeac0d2c6ae0902489'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.572161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] The token cache is being invalidate because project fd2e0926778747809c5d03f1b4011919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:06.572567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.573542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2584252d-53b3-4335-99d0-1dc17ec26ab9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.576011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 979/1970] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:06 2022] DELETE /identity/v3/projects/fd2e0926778747809c5d03f1b4011919 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:06.578975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6a2c51054a4eaeac0d2c6ae0902489'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.582444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870503-cf85-4ed2-b011-d24385fdad8e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.582922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870503-cf85-4ed2-b011-d24385fdad8e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.584057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd870503-cf85-4ed2-b011-d24385fdad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.595908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6a2c51054a4eaeac0d2c6ae0902489'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.596770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6a2c51054a4eaeac0d2c6ae0902489'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.597470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-28b46c27-fc26-4795-8566-ae650ff9d94b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6a2c51054a4eaeac0d2c6ae0902489'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:06.605344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fd870503-cf85-4ed2-b011-d24385fdad8e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:06.606554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fd870503-cf85-4ed2-b011-d24385fdad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.613048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 992/1971] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:06 2022] DELETE /identity/v3/users/6c6a2c51054a4eaeac0d2c6ae0902489 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:06.617335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.617622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.617900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.639911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:06.641452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.682193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 980/1972] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:06.690173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.690455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.690730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.725974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:06.727552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:06.728929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.745964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 981/1973] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:06.746759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 993/1974] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:06.749927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.757960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57970c4-7f51-47b1-aade-f72102bb437f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:06.766936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:06.766936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.766936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.766936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.767350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:06.767350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:06.768958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:06.789664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 982/1975] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:06.799105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.812305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f7239b-3d3e-45f8-84a7-b8699a3cc475 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:06.817359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:06.818043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:06.818459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:06.818744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:06.819517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:06.821596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:06.825145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.827122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:06.852771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:06.892050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 994/1976] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:06 2022] POST /identity/v3/projects => generated 407 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:06.896828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:06.939821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531ea4-a312-4dd5-94c0-75dc632e1238 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.012091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.012828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.013116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.013390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.023850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e73a60-be75-4087-8fb6-ef8cd523b86d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.032960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.034484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.035240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.035993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.036353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.036634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.039235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.042674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.054000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 983/1977] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:07.069400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 995/1978] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:06 2022] POST /identity/v3/users => generated 304 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:07.071107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.081120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ecf381-0daa-4d48-9f9d-909db04433b5 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.087807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.088943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.088943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.089152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.089821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.091520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.103305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 984/1979] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:07.107375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.117680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71f322-42c6-4bd5-b5f8-2925bf9653c5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.122986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.123678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.123958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.125482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.126364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.128159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fedc9-0e97-47ee-9cdb-99594082630d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.143966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 996/1980] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:07.146634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.157934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23840e22-f5bb-41da-afe4-6bef3079c163 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.163638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.164618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.164894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.165207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] PATH_INFO: `/v3/projects/539fbc14799f4b368172d1b0dbbfabed/users/036ae3014bf54036884ca67cbdc6c3cc/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.183028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=539fbc14799f4b368172d1b0dbbfabed, user_id=036ae3014bf54036884ca67cbdc6c3cc, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.185959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.203895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 985/1981] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:07 2022] PUT /identity/v3/projects/539fbc14799f4b368172d1b0dbbfabed/users/036ae3014bf54036884ca67cbdc6c3cc/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:07.217707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.218260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.218842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.253986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] MFA Rules not processed for user `036ae3014bf54036884ca67cbdc6c3cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:07.256198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:07.377228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 997/1982] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:07.377791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.450067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd61fed3-365c-4013-b34e-1ccd23619c80 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.452888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.453243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.453547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.453888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.454820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.456983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.526428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 986/1983] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:07 2022] POST /identity/v3/projects => generated 409 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:07.527806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.539519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12419092-07ce-4d35-95ef-6ce55f54db94 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.588468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:07.614941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.616012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.616463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.616877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.618754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.620888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.649613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 998/1984] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:07 2022] POST /identity/v3/users => generated 311 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:07.651241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.663676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c399340c-1ba0-4419-b80e-ecfa810c0b69 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.669288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.670064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.670411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.670773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.671590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.673430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.688881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 987/1985] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:07.692390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.704168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979daf5-d407-4841-a22d-a8ffd294369c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.735713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.739803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.740155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.752245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] PATH_INFO: `/v3/projects/2b432a85460d42e9add3178d8c0cfd90/users/0496c5ed46024e02ae3a4918d962438b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.774126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b432a85460d42e9add3178d8c0cfd90, user_id=0496c5ed46024e02ae3a4918d962438b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.776989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.793018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 999/1986] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:07 2022] PUT /identity/v3/projects/2b432a85460d42e9add3178d8c0cfd90/users/0496c5ed46024e02ae3a4918d962438b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:07.797046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.808860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc8b01-7c7b-4a8e-b5f1-cdcbccd05bd5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.816805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:07.888358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.889094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.889349 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.889644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.890385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.892610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.892743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.895043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:07.911705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 988/1987] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:07 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:07.917496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:07.922335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31917ab-6368-420c-a930-40750b83d68b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.927881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.928923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.929269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.929611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] PATH_INFO: `/v3/projects/c540911dfdaf44bb8d7273958d35633c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.931471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c540911dfdaf44bb8d7273958d35633c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.934260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.940084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e899a2-60e3-4b1a-9fe9-f837e4871e0e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:07.957931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:07.959560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.959720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.960202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] PATH_INFO: `/v3/projects/2b432a85460d42e9add3178d8c0cfd90/users/0496c5ed46024e02ae3a4918d962438b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:07.962527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b432a85460d42e9add3178d8c0cfd90, user_id=0496c5ed46024e02ae3a4918d962438b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:07.965566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8ffb6-2528-4c59-b600-4ee74260d8f4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:07.986607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 989/1988] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:07 2022] PUT /identity/v3/projects/2b432a85460d42e9add3178d8c0cfd90/users/0496c5ed46024e02ae3a4918d962438b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:07.989185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:07.989475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:07.989768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:08.030393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c540911dfdaf44bb8d7273958d35633c', 'request_id': 'req-9ed51d66-cfdd-456b-bd69-d5fc095a6678'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.037928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] MFA Rules not processed for user `0496c5ed46024e02ae3a4918d962438b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:08.039658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:08.042177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c540911dfdaf44bb8d7273958d35633c', 'request_id': 'req-9ed51d66-cfdd-456b-bd69-d5fc095a6678'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.059355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c540911dfdaf44bb8d7273958d35633c', 'request_id': 'req-9ed51d66-cfdd-456b-bd69-d5fc095a6678'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.082279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] The token cache is being invalidate because project c540911dfdaf44bb8d7273958d35633c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:08.082573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.083255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.085394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1000/1989] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:07 2022] DELETE /identity/v3/projects/c540911dfdaf44bb8d7273958d35633c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:08.089463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:08.090873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:08.143578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 990/1990] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:08.152403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:08.153897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:08.161955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed51d66-cfdd-456b-bd69-d5fc095a6678 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:08.166834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:08.167732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:08.168011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:08.168342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] PATH_INFO: `/v3/users/4ccc8209e28645fdb5a0bbe972ae0622` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:08.169550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccc8209e28645fdb5a0bbe972ae0622)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:08.171487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:08.215302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:DELETE=12 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:08.224097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5596805-7d1b-45f9-b668-1e7c2475c398 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:08.231162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:08.231406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccc8209e28645fdb5a0bbe972ae0622'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.231863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:08.232174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:08.232474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:08.244519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:08.246218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:08.254789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccc8209e28645fdb5a0bbe972ae0622'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.260170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 991/1991] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:08.277278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccc8209e28645fdb5a0bbe972ae0622'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.278054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccc8209e28645fdb5a0bbe972ae0622'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.278668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccc8209e28645fdb5a0bbe972ae0622'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:08.294432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1001/1992] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:08 2022] DELETE /identity/v3/users/4ccc8209e28645fdb5a0bbe972ae0622 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:08.483532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:08.495451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd9003-f8f1-482f-b12d-bd0bc020e02c service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:08.518626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:08.564544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:08.565226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:08.565635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:08.565910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:08.567822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:08.661129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:08.662711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921cd84-342d-40ce-8485-61686f239dca service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:08.698820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 992/1993] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:08.849370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:08.851326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:08.971409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9dc79-6ce2-46b0-adac-50705fd5baeb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:08.979015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:08.980265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:08.980694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:08.981268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] PATH_INFO: `/v3/projects/448b841d75974352b8774cff11d988b9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:08.982725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448b841d75974352b8774cff11d988b9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:08.985097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.053394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448b841d75974352b8774cff11d988b9', 'request_id': 'req-89c33c34-e622-4caf-86be-f87c66278976'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:09.061519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448b841d75974352b8774cff11d988b9', 'request_id': 'req-89c33c34-e622-4caf-86be-f87c66278976'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:09.074076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448b841d75974352b8774cff11d988b9', 'request_id': 'req-89c33c34-e622-4caf-86be-f87c66278976'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:09.086997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] The token cache is being invalidate because project 448b841d75974352b8774cff11d988b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:09.087228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:09.087928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-89c33c34-e622-4caf-86be-f87c66278976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:09.089958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1002/1994] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:08 2022] DELETE /identity/v3/projects/448b841d75974352b8774cff11d988b9 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:09.095514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.099568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.102227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.141276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:09.144563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:09.230618 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 993/1995] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:09.239668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.239952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.240260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.258935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:09.260207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:09.268635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1003/1996] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:09.273059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.282896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1829cf-e536-48bc-bf9a-7c24297c35e7 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.287585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.288329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.288609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.288884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.289624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:09.289929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.291625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.304446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 994/1997] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:09.309031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.318789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2d198-60ae-44c1-b107-8c401fdcb47a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.324090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.324797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.325070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.325339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.326053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.327950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.359161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1004/1998] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:09.363417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.373717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c79855-742e-4e5f-8dac-2fc2c69be0f9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.434044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.434637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.434916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.435190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.435896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.437954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.445924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:09.460057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 995/1999] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:09.464369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.475460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bbed38-37fd-454d-8f18-b3aa0be6a19b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.481086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.481885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.482255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.482520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.483266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.484991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.496377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1005/2000] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:09.500645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.511282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550143c-9fbb-49ce-aa56-07a73aa6fed2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.516726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.517407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.517690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.517962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.518761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.520417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9aa029-c590-4d52-9236-06ba53882c5f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.531171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 996/2001] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:09.535601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.541410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:09.547098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353ca70-b939-4094-8d76-105d69359e06 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.554463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.555735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.556445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.556813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] PATH_INFO: `/v3/projects/69eef1be1a684827987af71053a929eb/users/c26661b75199419e8d5256515950ac3e/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.574834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69eef1be1a684827987af71053a929eb, user_id=c26661b75199419e8d5256515950ac3e, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.577571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.600017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1006/2002] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:09 2022] PUT /identity/v3/projects/69eef1be1a684827987af71053a929eb/users/c26661b75199419e8d5256515950ac3e/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:09.614052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.614761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.615230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.649511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] MFA Rules not processed for user `c26661b75199419e8d5256515950ac3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:09.650775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:09.725080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 997/2003] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:09.731135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.839005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c3bbf-e221-48d1-b2d8-a21788d09851 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.844931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.845859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.846138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.846407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.847123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.849148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:09.881906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1007/2004] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:09.886100 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:09.897519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addce6b1-1f8b-4f31-836a-9e7e11b803d6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:09.982309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:09.982309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:09.982309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:09.982309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:09.983019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:09.985227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.031665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 998/2005] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:09 2022] POST /identity/v3/users => generated 296 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:10.035847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.047646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799640-89f7-4dd4-8b37-d20370890844 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.056089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.056925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.057289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.057657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.058556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.060339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.077402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1008/2006] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:10.080681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.092795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec9f107-b3d6-477f-a76e-5be473d5e1d4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.098954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.100027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.100574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.100942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] PATH_INFO: `/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b/users/759e75ced209470da79ab762fa0da98b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.124751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33be7d6600cb4286b81d93aaf0dcb59b, user_id=759e75ced209470da79ab762fa0da98b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.129214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.155634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 999/2007] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:10 2022] PUT /identity/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b/users/759e75ced209470da79ab762fa0da98b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:10.159743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.183359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bee8ce6-b106-4c2a-9612-6b61e965424c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.261630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.262339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.262625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.262933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.263680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.265363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94590d-d759-4952-bf4c-91ce029a859b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.277078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1009/2008] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:10.281907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.292908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e1c0f4-2edd-4a1d-9722-6999b4ef6627 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.301049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.301970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.302315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.302664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] PATH_INFO: `/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b/users/759e75ced209470da79ab762fa0da98b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.305386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33be7d6600cb4286b81d93aaf0dcb59b, user_id=759e75ced209470da79ab762fa0da98b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.308342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.325310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1000/2009] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:10 2022] PUT /identity/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b/users/759e75ced209470da79ab762fa0da98b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:10.335895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.336305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.336773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.372533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] MFA Rules not processed for user `759e75ced209470da79ab762fa0da98b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:10.373760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:10.417128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:10.451947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1010/2010] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:10.464967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.466759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:10.493232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:10.530391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc35a31-3d94-4052-abe0-637d14e5eb87 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.537092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.538028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.538432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.538841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.550507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.551974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.562782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1001/2011] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:10.907282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.924680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbda6c-e0fd-48a3-8f26-3a044f09432a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.931036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759e75ced209470da79ab762fa0da98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33be7d6600cb4286b81d93aaf0dcb59b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.931908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.932285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.932764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.933604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:10.933977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.935904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:10.960655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1011/2012] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:10.964162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:10.974348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e525d6cd-9224-4325-9a02-7bfe662a7e24 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:10.979320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759e75ced209470da79ab762fa0da98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33be7d6600cb4286b81d93aaf0dcb59b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:10.980047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:10.980359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:10.980638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:10.981370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:10.983251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:11.016273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1002/2013] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:10 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:11.025714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:11.037688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285390c-3ff7-451a-8156-0604b3ea8b93 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:11.101773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759e75ced209470da79ab762fa0da98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33be7d6600cb4286b81d93aaf0dcb59b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:11.102495 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:11.102826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:11.103105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:11.103854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:11.104223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:11.105878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:11.119189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1012/2014] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:05:11.160990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:11.173925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15549518-1be1-48a2-b330-a975fc4b2372 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:11.179013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '759e75ced209470da79ab762fa0da98b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33be7d6600cb4286b81d93aaf0dcb59b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:11.179445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:11.179673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:11.179946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] PATH_INFO: `/v3/projects/a90665fca3524318bf085d15760125bd` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:11.181398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a90665fca3524318bf085d15760125bd)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:11.183320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:11.238067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a90665fca3524318bf085d15760125bd', 'request_id': 'req-123c8a68-2a82-45d9-8897-28c2fe9bfdec'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:11.258186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a90665fca3524318bf085d15760125bd', 'request_id': 'req-123c8a68-2a82-45d9-8897-28c2fe9bfdec'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:11.270276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a90665fca3524318bf085d15760125bd', 'request_id': 'req-123c8a68-2a82-45d9-8897-28c2fe9bfdec'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:11.292246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] The token cache is being invalidate because project a90665fca3524318bf085d15760125bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:11.292246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:11.292246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-123c8a68-2a82-45d9-8897-28c2fe9bfdec tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:11.292246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1003/2015] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:11 2022] DELETE /identity/v3/projects/a90665fca3524318bf085d15760125bd => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:11.643982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:11.646156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:11.841212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc692-1414-477f-9d97-06b9f52d5558 tempest-VolumeQuotaClassesTest-920979654 tempest-VolumeQuotaClassesTest-920979654-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:11.920711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:11.921615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:11.921892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:11.922164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] PATH_INFO: `/v3/users/c26661b75199419e8d5256515950ac3e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:11.923426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26661b75199419e8d5256515950ac3e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:11.925405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:11.929385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:11.989856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26661b75199419e8d5256515950ac3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.000367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26661b75199419e8d5256515950ac3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.014996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26661b75199419e8d5256515950ac3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.015204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26661b75199419e8d5256515950ac3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.015744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26661b75199419e8d5256515950ac3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.034018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1013/2016] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:11 2022] DELETE /identity/v3/users/c26661b75199419e8d5256515950ac3e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:12.038592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:12.039067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:12.039175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:12.058238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:12.059521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:12.129912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1004/2017] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:12.139845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:12.141364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:12.201019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af2801-b69a-458c-bdf4-d0a68219d9f2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:12.204999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:12.205652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:12.205923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:12.206188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:12.216223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:12.217653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:12.227834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1014/2018] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:12.627752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:12.629396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:12.643398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164ae18-24d4-4235-8bd5-f0b6da7feba1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:12.650157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:12.651122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:12.651400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:12.651774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] PATH_INFO: `/v3/projects/69eef1be1a684827987af71053a929eb` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:12.653275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] RBAC: Authorizing `identity:delete_project(project_id=69eef1be1a684827987af71053a929eb)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:12.655338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:12.698678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:12.727213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69eef1be1a684827987af71053a929eb', 'request_id': 'req-3c5ac934-16e4-4c13-ad50-bf643e18454e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.739697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69eef1be1a684827987af71053a929eb', 'request_id': 'req-3c5ac934-16e4-4c13-ad50-bf643e18454e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.757305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69eef1be1a684827987af71053a929eb', 'request_id': 'req-3c5ac934-16e4-4c13-ad50-bf643e18454e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.770251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] The token cache is being invalidate because project 69eef1be1a684827987af71053a929eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:12.770535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.771227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.773006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1005/2019] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:12 2022] DELETE /identity/v3/projects/69eef1be1a684827987af71053a929eb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:12.777130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:12.787422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ef180-0518-49b9-a312-9d0261f586b1 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:12.864107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:12.866697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:12.866965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:12.867240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] PATH_INFO: `/v3/users/759e75ced209470da79ab762fa0da98b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:12.872159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759e75ced209470da79ab762fa0da98b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:12.875528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:12.912052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:12.939307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759e75ced209470da79ab762fa0da98b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.949451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759e75ced209470da79ab762fa0da98b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.963024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759e75ced209470da79ab762fa0da98b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.964326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759e75ced209470da79ab762fa0da98b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.964928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c0e4bb5c-1799-4970-9cc1-71f85429bd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759e75ced209470da79ab762fa0da98b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:12.979489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1015/2020] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:12 2022] DELETE /identity/v3/users/759e75ced209470da79ab762fa0da98b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:13.755167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:13.757291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:13.771936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5ac934-16e4-4c13-ad50-bf643e18454e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:13.873578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:13.874903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:13.875366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:13.875805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] PATH_INFO: `/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:13.877090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33be7d6600cb4286b81d93aaf0dcb59b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:13.879242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:13.935386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33be7d6600cb4286b81d93aaf0dcb59b', 'request_id': 'req-594d321e-78b1-4954-a14b-9a91123f8e90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:13.945771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33be7d6600cb4286b81d93aaf0dcb59b', 'request_id': 'req-594d321e-78b1-4954-a14b-9a91123f8e90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:13.953903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33be7d6600cb4286b81d93aaf0dcb59b', 'request_id': 'req-594d321e-78b1-4954-a14b-9a91123f8e90'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:13.968295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] The token cache is being invalidate because project 33be7d6600cb4286b81d93aaf0dcb59b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:13.968592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:13.969261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-594d321e-78b1-4954-a14b-9a91123f8e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:13.971436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1006/2021] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:13 2022] DELETE /identity/v3/projects/33be7d6600cb4286b81d93aaf0dcb59b => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:13.976435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:13.976878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:13.976965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.041914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:14.044765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.109345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1016/2022] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:14.117857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.118179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.118456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.144829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:14.146101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.154223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1007/2023] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:14.158563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.168508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e638711-1145-4512-8bb4-6f0d4b49e781 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.173168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.173894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.174174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.174445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.175180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:14.175485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.177134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.192672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1017/2024] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:14.194119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.204185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6068b5c-e292-43b8-8649-2de69c63b9c6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.209615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.210330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.210804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.211177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.211992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.214007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.250432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1008/2025] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:14 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:14.255048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.265688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c2c0b-35e6-460c-a777-91dbbc422f61 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.325204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.325891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.326172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.326446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.327183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.330552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.358895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1018/2026] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:14 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:14.365033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.389532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e47d2-22ef-4734-a97d-9ffc5c30fef1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.395918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.395918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.395918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.395918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.396899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.398593 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.404358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:14.413348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1009/2027] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:14.414741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.425505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306e48a0-741c-4e77-84d4-70bee957e0d5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.431736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.432535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.432880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.433215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.434503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.435691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141eafa1-e5a1-4d0a-8b59-f149faa0ed5b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.448931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1019/2028] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:14.453416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.465938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16139cd0-b6d7-499f-b2c2-42f384de9538 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.472195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.473323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.473725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.474058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] PATH_INFO: `/v3/projects/e3c43cec3c1b4a48a4814ae1dd938ffa/users/fee14e4c35544359b6b01797e1620ced/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.490449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3c43cec3c1b4a48a4814ae1dd938ffa, user_id=fee14e4c35544359b6b01797e1620ced, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.494018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.509581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1010/2029] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:14 2022] PUT /identity/v3/projects/e3c43cec3c1b4a48a4814ae1dd938ffa/users/fee14e4c35544359b6b01797e1620ced/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:14.514996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.515353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.515886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.530427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.532243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.535826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:14.537246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.541397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:14.628759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c87dad-c585-4c20-8391-872a27df91c6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.633197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1020/2030] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:14.634196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.635095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.635394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.635663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] PATH_INFO: `/v3/users/036ae3014bf54036884ca67cbdc6c3cc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.636885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=036ae3014bf54036884ca67cbdc6c3cc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.638807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.643053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.645377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.705673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036ae3014bf54036884ca67cbdc6c3cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:14.720839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036ae3014bf54036884ca67cbdc6c3cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:14.721623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036ae3014bf54036884ca67cbdc6c3cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:14.722328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036ae3014bf54036884ca67cbdc6c3cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:14.740617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e57b08b7-b2b4-453f-afe3-1329f08f15ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036ae3014bf54036884ca67cbdc6c3cc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:14.750947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27beebe0-8a7d-431d-b684-52e9e30a733b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.756382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.757370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.757789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.758213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.759553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1011/2031] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:14 2022] DELETE /identity/v3/users/036ae3014bf54036884ca67cbdc6c3cc => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:14.762907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.763291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.763946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.764450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:14.778425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:14.779993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:14.785353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:14.786759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.791149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1021/2032] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:14.852034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:14.869271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1012/2033] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:14.889787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:14.891315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:14.903606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d900b9-2d76-4935-a4c3-0ff143a6a223 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:14.992024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:14.992731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:14.993199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:14.993638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:15.006105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:15.010169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:15.022769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1022/2034] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:15.445757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:15.447391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:15.462726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d734dbb-cef2-4bd2-ade9-415573e6c6ab None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:15.474745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:15.478956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:15.478956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:15.478956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] PATH_INFO: `/v3/projects/539fbc14799f4b368172d1b0dbbfabed` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:15.480736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=539fbc14799f4b368172d1b0dbbfabed)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:15.484207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:15.537516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '539fbc14799f4b368172d1b0dbbfabed', 'request_id': 'req-e88d8296-42d7-4b98-90ba-34881bede381'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.546537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '539fbc14799f4b368172d1b0dbbfabed', 'request_id': 'req-e88d8296-42d7-4b98-90ba-34881bede381'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.552656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '539fbc14799f4b368172d1b0dbbfabed', 'request_id': 'req-e88d8296-42d7-4b98-90ba-34881bede381'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.565345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] The token cache is being invalidate because project 539fbc14799f4b368172d1b0dbbfabed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:15.565720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.566432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e88d8296-42d7-4b98-90ba-34881bede381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.571174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1013/2035] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:15 2022] DELETE /identity/v3/projects/539fbc14799f4b368172d1b0dbbfabed => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:15.572429 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:15.583126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f257b-914a-42df-898d-d9420df896b0 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:15.646007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:15.653353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:15.654319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:15.654602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:15.654871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] PATH_INFO: `/v3/users/0496c5ed46024e02ae3a4918d962438b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:15.656580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0496c5ed46024e02ae3a4918d962438b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:15.658698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:15.715634 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0496c5ed46024e02ae3a4918d962438b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.726035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0496c5ed46024e02ae3a4918d962438b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.742087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0496c5ed46024e02ae3a4918d962438b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.743586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0496c5ed46024e02ae3a4918d962438b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.744249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0496c5ed46024e02ae3a4918d962438b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:15.756960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1023/2036] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:15 2022] DELETE /identity/v3/users/0496c5ed46024e02ae3a4918d962438b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:15.959529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:15.960060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:15.960186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:15.988148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] MFA Rules not processed for user `fee14e4c35544359b6b01797e1620ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:15.989619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.052741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.055312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.085466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1014/2037] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:16.101025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.104361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.176916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55808b-c98f-4a4c-a6d8-3ead4b7066c0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.177160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3609b-482e-46f5-8468-0bdf96386606 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.181352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.181837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.182013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.182297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.182570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.183335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.183773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.184636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] PATH_INFO: `/v3/projects/2b432a85460d42e9add3178d8c0cfd90` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.186036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b432a85460d42e9add3178d8c0cfd90)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.193680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.200023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.201546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b5da8-1b47-4923-884b-e339b78d3112 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.212131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1015/2038] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:16.262977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b432a85460d42e9add3178d8c0cfd90', 'request_id': 'req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:16.270127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b432a85460d42e9add3178d8c0cfd90', 'request_id': 'req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:16.280835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b432a85460d42e9add3178d8c0cfd90', 'request_id': 'req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:16.291791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] The token cache is being invalidate because project 2b432a85460d42e9add3178d8c0cfd90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:16.292082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:16.292783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d7a9fb88-52f9-4b82-89c0-4e2c137ddadc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:16.294676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1024/2039] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:16 2022] DELETE /identity/v3/projects/2b432a85460d42e9add3178d8c0cfd90 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:16.299612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.299897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.300196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.317927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:16.319481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.336428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:16.438811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1016/2040] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:16.448059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.448281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.448555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.456268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:16.471861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:16.473134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.496152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1025/2041] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:16.501251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.513883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ac87c-8a51-4b07-bf69-ef77d1e036f5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.518997 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.519731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.520076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.520384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.521283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:16.521731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.531095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.540158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1017/2042] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:16.542973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.552430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e87c36-c35a-42ab-8afa-4add49f4e7b4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.557206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.557864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.558423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.558423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.559161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.561221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.599444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1026/2043] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:16 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:16.603880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.614076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a944f4-81e2-47da-af4a-89b8aba30e0d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.671845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.672568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.672851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.673119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.673848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.675799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.699444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1018/2044] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:16 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:16.701085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.713130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607107-f24c-4896-9af4-bda64348ad22 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.718479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.719188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.719469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.719742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.720642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.722260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.733395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1027/2045] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:16.737821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.750189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1dd140-0cd7-41c1-82d5-d77f66753aab admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.754920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.755594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.755880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.756181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.756927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.758568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc72586-12f3-44ed-bda8-fc0f88b68b48 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.769536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1019/2046] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:16.773882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.800859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a165868-b5c1-49d3-a8af-51291fa7a20e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:16.808663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:16.809557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.809834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.810097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] PATH_INFO: `/v3/projects/c52bead68b4d4de0b1c7b13221051218/users/7043693253ba41ee948c89823c9b723a/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.826067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c52bead68b4d4de0b1c7b13221051218, user_id=7043693253ba41ee948c89823c9b723a, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:16.828824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:16.846604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1028/2047] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:16 2022] PUT /identity/v3/projects/c52bead68b4d4de0b1c7b13221051218/users/7043693253ba41ee948c89823c9b723a/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:16.860435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004786b-8f06-4b70-86a7-a013b8d7b2ce None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:16.860678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004786b-8f06-4b70-86a7-a013b8d7b2ce None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:16.860977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004786b-8f06-4b70-86a7-a013b8d7b2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:16.888973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1004786b-8f06-4b70-86a7-a013b8d7b2ce None None] MFA Rules not processed for user `7043693253ba41ee948c89823c9b723a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:16.890267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1004786b-8f06-4b70-86a7-a013b8d7b2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:16.956226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1020/2048] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:16.969142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:16.971556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:17.037735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9896fd2c-a3e0-405f-9d53-0729416cda5b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:17.042007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:17.043231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:17.043512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:17.043782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:17.053915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:17.056177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:17.070919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1029/2049] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:17.608527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:17.609114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:17.609114 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:17.621510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:17.631913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] MFA Rules not processed for user `fee14e4c35544359b6b01797e1620ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:17.633199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:17.695164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1021/2050] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:27.063045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:27.683778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=22 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:30.819687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:30.821303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:30.898449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760487f-f5f0-4bd2-9758-edfa8823ad93 service glance] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:30.904928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:30.906408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:30.907771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:30.907771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] PATH_INFO: `/v3/users/aa55b383fe014d648c466919e16ffb7f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:30.908890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa55b383fe014d648c466919e16ffb7f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:30.911111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:30.972920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa55b383fe014d648c466919e16ffb7f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:30.983128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa55b383fe014d648c466919e16ffb7f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.001817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa55b383fe014d648c466919e16ffb7f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.002686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa55b383fe014d648c466919e16ffb7f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.004703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9d8ef343-8a2d-4d2e-b6fc-f9cfd254b674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa55b383fe014d648c466919e16ffb7f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.018969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1030/2051] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:30 2022] DELETE /identity/v3/users/aa55b383fe014d648c466919e16ffb7f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:31.197513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.209411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c5617-206f-4ce2-93d9-8007176f3d4b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.273465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.274353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.274632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.274901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] PATH_INFO: `/v3/projects/e09a7d203d614ea587dcbea88776b310` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.276298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09a7d203d614ea587dcbea88776b310)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.278231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.330673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09a7d203d614ea587dcbea88776b310', 'request_id': 'req-1ce13242-6a36-4e9c-af0b-e2fde04308c6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.339766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09a7d203d614ea587dcbea88776b310', 'request_id': 'req-1ce13242-6a36-4e9c-af0b-e2fde04308c6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.346423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09a7d203d614ea587dcbea88776b310', 'request_id': 'req-1ce13242-6a36-4e9c-af0b-e2fde04308c6'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.361500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] The token cache is being invalidate because project e09a7d203d614ea587dcbea88776b310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:31.361903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.362635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ce13242-6a36-4e9c-af0b-e2fde04308c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:31.364323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1022/2052] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:31 2022] DELETE /identity/v3/projects/e09a7d203d614ea587dcbea88776b310 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:31.375690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.375980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.376289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.398707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:31.399920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:31.467059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1031/2053] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:31.476014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.476302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.476522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.497308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:31.498578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:31.508150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1023/2054] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:31.512960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.522991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de988148-eca9-488c-8f21-6de2a0d1ba64 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.528515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.529204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.529457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.529729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.530472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:31.530772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.532427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.544917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1032/2055] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:31.549648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.561172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a26603e-df88-4975-aac4-cb8eb603cbed None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.567584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.568312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.568600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.569006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.569718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.571649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.603563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1024/2056] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:31.604924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.615502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c307f8-6771-4e45-8e01-154d44ced74d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.619493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:31.673811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.674535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.674817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.675090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.675791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.677795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.704265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1033/2057] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:31.710792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.722625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13688-4b91-4256-ad44-74a00d3515e7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.727900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.728551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.728828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.729095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.729812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.731420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.742223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1025/2058] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:31.746407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.756620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b0a9-8972-4ed3-ae7b-3c5a6286d865 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.761781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.762428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.762709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.762974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.763690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.765866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73d5dc-16fc-41dc-820f-c1deac745f0e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.777793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1034/2059] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:31.782806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.794184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed51c5-fef4-4c0b-8f18-191106fbeb21 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:31.798959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:31.799908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.800184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.800485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] PATH_INFO: `/v3/projects/016f2f272aa545fcb549a62dea13d347/users/da02d6aee39243dab5aaa1aa01234227/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.815388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=016f2f272aa545fcb549a62dea13d347, user_id=da02d6aee39243dab5aaa1aa01234227, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:31.818049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:31.833433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1026/2060] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:31 2022] PUT /identity/v3/projects/016f2f272aa545fcb549a62dea13d347/users/da02d6aee39243dab5aaa1aa01234227/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:31.843696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:31.844211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:31.844303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:31.871690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] MFA Rules not processed for user `da02d6aee39243dab5aaa1aa01234227`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:31.872963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:31.953307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1035/2061] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:31.958243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:31.989234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:32.022688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae592f8-ef32-4972-8789-933a819977bc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.027425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.028075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.028385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.028650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.029339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.031231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.058448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1027/2062] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:31 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:32.062575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.073410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7374c2-ba92-434b-9b0e-96b8908e349f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.131528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.132246 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.132653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.132926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.133621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.135670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.161095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1036/2063] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:32 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:32.162251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.172741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad3c376-8037-44a2-bf71-fd0cc905c0e3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.178112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.178893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.179236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.179570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.180420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.182327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.193419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1028/2064] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:32.198005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.210909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:32.214247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac4c550-31d7-4709-97d7-6ad6af0a0cad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.220335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.221604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.222086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.222552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] PATH_INFO: `/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28/users/9bebf235b2d64490a80305c4d5bb2ab3/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.240137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a46b799ef4c434fbf6d84fc0dc24e28, user_id=9bebf235b2d64490a80305c4d5bb2ab3, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.243067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.260736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1037/2065] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:32 2022] PUT /identity/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28/users/9bebf235b2d64490a80305c4d5bb2ab3/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:32.264599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.275006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693f171-37a4-4f8a-bf4d-f608d7df6e9b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.332245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.333217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.333498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.333769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.334494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.336090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611491f4-55e2-4b4a-8615-aeb5190c7cd3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.345825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1029/2066] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:32.350148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.360812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17a981-3fba-4b7c-8af6-6c6881b6ff97 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.366292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.367159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.367682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.367956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] PATH_INFO: `/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28/users/9bebf235b2d64490a80305c4d5bb2ab3/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.370238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a46b799ef4c434fbf6d84fc0dc24e28, user_id=9bebf235b2d64490a80305c4d5bb2ab3, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.372919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.384316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1038/2067] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:32 2022] PUT /identity/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28/users/9bebf235b2d64490a80305c4d5bb2ab3/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:32.395192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.395556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.396238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.423704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] MFA Rules not processed for user `9bebf235b2d64490a80305c4d5bb2ab3`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:32.424964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:32.506488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1030/2068] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:32.517739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.519454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:32.588548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bab85e7-1053-451b-b201-ddffcafc7e31 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.592269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.592929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.593202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.593468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.603739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.605269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fabfe-766b-4d95-ae24-2a9dda32fff9 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.616249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1039/2069] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:32.644472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.685002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:32.730413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739fb48-a2bb-44c8-ae9b-27b147ad020c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:32.734948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:32.735870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.736274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.736578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] PATH_INFO: `/v3/users/da02d6aee39243dab5aaa1aa01234227` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.738026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da02d6aee39243dab5aaa1aa01234227)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:32.740281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:32.808534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da02d6aee39243dab5aaa1aa01234227'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:32.818252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da02d6aee39243dab5aaa1aa01234227'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:32.819203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da02d6aee39243dab5aaa1aa01234227'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:32.820062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da02d6aee39243dab5aaa1aa01234227'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:32.835940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da02d6aee39243dab5aaa1aa01234227'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:32.849410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1031/2070] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:32 2022] DELETE /identity/v3/users/da02d6aee39243dab5aaa1aa01234227 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:32.853994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:32.854478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:32.854598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:32.873000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:32.874299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:32.938964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1040/2071] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:32.948346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:32.949746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:33.011102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b63bdc-01bd-40bf-b2af-ad75f6d88dfb admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:33.015616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:33.016269 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:33.016550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:33.016947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:33.027064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:33.028616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:33.039064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1032/2072] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:33.319767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:33.321532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:33.336484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f57c-6227-4c02-9446-2f886378abfd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:33.342262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:33.343218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:33.343613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:33.344415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] PATH_INFO: `/v3/projects/016f2f272aa545fcb549a62dea13d347` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:33.345318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=016f2f272aa545fcb549a62dea13d347)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:33.347456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:33.400327 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016f2f272aa545fcb549a62dea13d347', 'request_id': 'req-7efb14c7-3fd6-427f-94e9-f003d5b554ef'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.407019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016f2f272aa545fcb549a62dea13d347', 'request_id': 'req-7efb14c7-3fd6-427f-94e9-f003d5b554ef'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.417532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016f2f272aa545fcb549a62dea13d347', 'request_id': 'req-7efb14c7-3fd6-427f-94e9-f003d5b554ef'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.422966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:33.432869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] The token cache is being invalidate because project 016f2f272aa545fcb549a62dea13d347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:33.433228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.434098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.436335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1041/2073] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:33 2022] DELETE /identity/v3/projects/016f2f272aa545fcb549a62dea13d347 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:33.440089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:33.451025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3cdaa-d8ee-4c10-8091-8e96fe486b68 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:33.502317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:33.518710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:33.519615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:33.519887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:33.520180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] PATH_INFO: `/v3/users/9bebf235b2d64490a80305c4d5bb2ab3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:33.521362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bebf235b2d64490a80305c4d5bb2ab3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:33.523321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:33.571844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bebf235b2d64490a80305c4d5bb2ab3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.580854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bebf235b2d64490a80305c4d5bb2ab3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.581508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bebf235b2d64490a80305c4d5bb2ab3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.582187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bebf235b2d64490a80305c4d5bb2ab3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.594794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f24c7b17-d226-4529-8dfe-6b5c84f23212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bebf235b2d64490a80305c4d5bb2ab3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:33.606972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1033/2074] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:33 2022] DELETE /identity/v3/users/9bebf235b2d64490a80305c4d5bb2ab3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:33.883615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:33.885368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:33.908053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb14c7-3fd6-427f-94e9-f003d5b554ef admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:33.972941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:33.973864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:33.974143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:33.974435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] PATH_INFO: `/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:33.975723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a46b799ef4c434fbf6d84fc0dc24e28)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:33.977617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.024777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a46b799ef4c434fbf6d84fc0dc24e28', 'request_id': 'req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.031020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a46b799ef4c434fbf6d84fc0dc24e28', 'request_id': 'req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.039795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a46b799ef4c434fbf6d84fc0dc24e28', 'request_id': 'req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.050275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] The token cache is being invalidate because project 1a46b799ef4c434fbf6d84fc0dc24e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:34.050555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.051187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f5b6935f-e2d3-41d9-bc80-e55cc00212cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.052890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1042/2075] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:33 2022] DELETE /identity/v3/projects/1a46b799ef4c434fbf6d84fc0dc24e28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:34.057958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.058242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.058517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.077167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:34.078373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:34.140818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1034/2076] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:34.150128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.150413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.150679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.170717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:34.172015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:34.180955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1043/2077] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:34.185402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.195478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed36ad-c414-404b-acff-1aea5f2f1673 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.200962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.201619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.201897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.202171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.202928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:34.203199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.204865 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.217000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1035/2078] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:34.221249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.230565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb919bc-8041-4eb9-a468-a2cc1255e15b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.235646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.236321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.236579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.236844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.237552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.239463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.267437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1044/2079] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:34.271580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.281985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5319ce-4e3f-4555-bc50-feefacf04cc5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.331461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:34.349645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.350301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.350608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.350840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.351549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.353507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.377935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1036/2080] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:34.382367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.393081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ec8a8-2976-41ad-95ee-d3eeba1e6234 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.397568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.398226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.398499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.398765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.399488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.401197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.411590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1045/2081] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:34.415374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.425826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f7fa89-4783-4aeb-88b2-9d3616dfbb0e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.431066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.431703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.432010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.432315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.433045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.434642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5c4a1-c27b-4bc0-b33d-b44223542a19 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.444635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1037/2082] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:34.449330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.465396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd0c4e-cc5f-4cc3-be3b-785784639839 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.473584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.474832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.475172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.475498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] PATH_INFO: `/v3/projects/c564759d132b4407ac4deb07b24c1738/users/76125740d8814b6bb511baa4d12e7548/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.494636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c564759d132b4407ac4deb07b24c1738, user_id=76125740d8814b6bb511baa4d12e7548, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.497288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.514194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1046/2083] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:34 2022] PUT /identity/v3/projects/c564759d132b4407ac4deb07b24c1738/users/76125740d8814b6bb511baa4d12e7548/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:34.524950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.525222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.525491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.553154 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] MFA Rules not processed for user `76125740d8814b6bb511baa4d12e7548`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:34.554379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:34.622201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1038/2084] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:34.634169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.635961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:34.658014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:34.695218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5167dc94-e435-40cb-84f8-de3274396e1e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.699575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.700326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.700610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.700911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.709916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.711367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926b2c3-4d76-465e-bcb0-b7dafe7fcf71 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.720585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1047/2085] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:34.740288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.805824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cee48-47f2-4725-9b57-d6556c2a1463 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:34.810908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:34.811782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.812054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.812433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] PATH_INFO: `/v3/users/76125740d8814b6bb511baa4d12e7548` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.813645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76125740d8814b6bb511baa4d12e7548)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:34.815560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:34.864897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76125740d8814b6bb511baa4d12e7548'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.872969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76125740d8814b6bb511baa4d12e7548'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.873648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76125740d8814b6bb511baa4d12e7548'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.874520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76125740d8814b6bb511baa4d12e7548'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.880189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:34.889191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76125740d8814b6bb511baa4d12e7548'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:34.902660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1039/2086] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:34 2022] DELETE /identity/v3/users/76125740d8814b6bb511baa4d12e7548 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:34.907279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:34.907739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:34.907981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:34.926434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:34.927642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:34.987093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1048/2087] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:34.997291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:34.999028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:35.064077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fc160-bc66-4bd0-87a9-f008d01bf926 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.068237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.068897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.069176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.069456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.079401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.081044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0f071-ef27-43ce-8d5c-b115ea694fb2 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.091400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1040/2088] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:35.447124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.448605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:35.461712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675dcee6-c80f-4e38-bcdb-825fdcd4c595 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.467031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.468017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.468371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.468648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] PATH_INFO: `/v3/projects/c564759d132b4407ac4deb07b24c1738` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.469918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c564759d132b4407ac4deb07b24c1738)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.472608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.522514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c564759d132b4407ac4deb07b24c1738', 'request_id': 'req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:35.528929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c564759d132b4407ac4deb07b24c1738', 'request_id': 'req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:35.537760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c564759d132b4407ac4deb07b24c1738', 'request_id': 'req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:35.549631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] The token cache is being invalidate because project c564759d132b4407ac4deb07b24c1738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:35.549918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:35.550644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-26a64e2d-1e54-4d0a-86a3-4c4ae12fe991 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:35.552326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1049/2089] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:35 2022] DELETE /identity/v3/projects/c564759d132b4407ac4deb07b24c1738 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:35.557666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.558146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.558233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.577354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:35.578559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:35.641220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1041/2090] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:35.649812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.650295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.650654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.672868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:35.674067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:35.683457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1050/2091] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:35.687667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.697836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e30fdc-6b06-4028-9f61-ce493feef2e3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.702704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.703367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.703644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.703941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.704808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:35.705110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.706701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.719224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1042/2092] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:35.723632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.735743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c82408-e08b-4779-87be-ba7a52ac4020 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.741881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.742655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.742933 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.743206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.743913 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.745999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.777226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1051/2093] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:35 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:35.778502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.790510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293807a9-79b5-4474-ab0b-806c469f4396 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.849570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.850248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.850523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.850817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.851510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.853466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.869074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:35.876886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1043/2094] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:35 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:35.881814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.893157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2064f-5e0e-423f-8aff-07d50fbadd3f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.898008 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.898679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.898956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.899232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.900159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.901857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.913095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1052/2095] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:35.917139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.927518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ed86c-f92e-44c5-b80b-fc65c70f0b60 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.933993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.935094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.935493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.935887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.936845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.938472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7098ca-ab7b-4fdc-856e-ec0d7314c9b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:35.950654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1044/2096] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:35.955170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:35.966334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc18733-5587-4aba-a031-9ed4d67b3407 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:35.972238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:35.973152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:35.973419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:35.973706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] PATH_INFO: `/v3/projects/7e7c6f75e76f4bae8c8d0d3b4dba057a/users/8d531555b11f4ca99e69ab35a0922ef7/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:35.976213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:35.992625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7c6f75e76f4bae8c8d0d3b4dba057a, user_id=8d531555b11f4ca99e69ab35a0922ef7, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:35.996566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:36.010726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1053/2097] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:35 2022] PUT /identity/v3/projects/7e7c6f75e76f4bae8c8d0d3b4dba057a/users/8d531555b11f4ca99e69ab35a0922ef7/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:36.021807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:36.022065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:36.022344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:36.049002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] MFA Rules not processed for user `8d531555b11f4ca99e69ab35a0922ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:36.050200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:36.117517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1045/2098] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:36.128554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:36.130326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:36.191131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa553a-a836-4ce9-be95-b611ae4c95bd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:36.195487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:36.196272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:36.196549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:36.196818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:36.205331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:36.206753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057eea13-6f18-4545-a589-47a6d7af9bf0 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:36.216461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1054/2099] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:45.765551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:45.880803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e36c2c-417d-415c-b762-24ae74856ab2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:45.885453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:45.886433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:45.886773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:45.887107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] PATH_INFO: `/v3/users/8d531555b11f4ca99e69ab35a0922ef7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:45.888418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d531555b11f4ca99e69ab35a0922ef7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:45.890557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:45.947203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d531555b11f4ca99e69ab35a0922ef7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:45.956503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d531555b11f4ca99e69ab35a0922ef7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:45.957110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d531555b11f4ca99e69ab35a0922ef7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:45.958095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d531555b11f4ca99e69ab35a0922ef7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:45.970843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d531555b11f4ca99e69ab35a0922ef7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:45.976476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:45.985063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1046/2100] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:45 2022] DELETE /identity/v3/users/8d531555b11f4ca99e69ab35a0922ef7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:45.989703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:45.990273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:45.990378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.009742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:46.011047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:46.072050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1055/2101] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:46.082230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.084176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:46.149228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d497fa7-e10d-4bfe-87f7-4f637977094a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.153020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.153669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.153948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.154216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.163341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.164829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b930c31-423a-4e89-9283-e230a29d5203 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.174235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1047/2102] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:46.458211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.459838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:46.473622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042ac55-3f47-4d7f-acf5-5bc4630e0206 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.479940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.481038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.481181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.481425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] PATH_INFO: `/v3/projects/7e7c6f75e76f4bae8c8d0d3b4dba057a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.482802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7c6f75e76f4bae8c8d0d3b4dba057a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.484902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.535555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7c6f75e76f4bae8c8d0d3b4dba057a', 'request_id': 'req-ef6b86bd-cfe3-4212-995d-f3c6a880e422'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:46.542037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7c6f75e76f4bae8c8d0d3b4dba057a', 'request_id': 'req-ef6b86bd-cfe3-4212-995d-f3c6a880e422'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:46.552593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7c6f75e76f4bae8c8d0d3b4dba057a', 'request_id': 'req-ef6b86bd-cfe3-4212-995d-f3c6a880e422'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:46.563132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] The token cache is being invalidate because project 7e7c6f75e76f4bae8c8d0d3b4dba057a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:46.563415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:46.564049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ef6b86bd-cfe3-4212-995d-f3c6a880e422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:46.565656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1056/2103] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:46 2022] DELETE /identity/v3/projects/7e7c6f75e76f4bae8c8d0d3b4dba057a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:46.571417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.571715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.571975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.590589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:46.591825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:46.654858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1048/2104] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:46.663359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.663549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.663753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.684859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:46.686102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:46.695580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1057/2105] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:46.700782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.711504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41544050-ef0d-4b49-bff9-635b75f699d6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.716365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.717082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.717362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.717637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.718398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:46.718683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.720363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.732291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1049/2106] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:46.737207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.742744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:46.748919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0952e1f-8a70-44f3-90cc-a33e5c520240 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.755415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.756407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.756882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.757213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.758100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.760073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.788094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1058/2107] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:46 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:46.792396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.803310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b057-5f29-4b82-b2ea-563bff2e0d4a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.861049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.861864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.862141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.862415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.863142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.865193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.889174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1050/2108] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:46 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:46.890349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.904625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b93db-0d8b-4048-8385-12bf2cdcf4c5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.911635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.912484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.912772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.913045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.913844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.915559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.934403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1059/2109] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:46.938417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.949192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9169aba-fd25-4b89-a2df-eb0e94ada8d1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.958153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.958960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.959332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.959666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:46.960557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:46.962185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3ea45-757a-4d89-928b-dcb97e74eeba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:46.976287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1051/2110] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:46.977470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:46.988096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192bb4f-582d-4f81-960e-fb07c1cc7b7a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:46.993064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:46.994031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:46.994276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:46.994578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] PATH_INFO: `/v3/projects/f2fe9e619bcc4c739bfce2a2a1325841/users/7ffe641a0d624981aef84cfcf028a277/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:47.009575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2fe9e619bcc4c739bfce2a2a1325841, user_id=7ffe641a0d624981aef84cfcf028a277, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:47.012290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:47.026494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1060/2111] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:46 2022] PUT /identity/v3/projects/f2fe9e619bcc4c739bfce2a2a1325841/users/7ffe641a0d624981aef84cfcf028a277/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:47.038029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:47.038516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:47.038947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:47.046551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:47.066067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] MFA Rules not processed for user `7ffe641a0d624981aef84cfcf028a277`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:47.067332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:47.131315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1052/2112] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:47.143973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:47.146081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:47.208098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af203c-91b5-4e07-a690-8700c55a7f7a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:47.211897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:47.212578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:47.212859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:47.213130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:47.221430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:47.222864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e0873-7fb3-4cf6-be9e-d41cbf2449f1 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:47.231616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1061/2113] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:50.936619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.001629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065dfcc-bc82-4f37-8f98-5b8800bfaf33 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.006489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:51.007366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.007638 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.007913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] PATH_INFO: `/v3/users/7ffe641a0d624981aef84cfcf028a277` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.009318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ffe641a0d624981aef84cfcf028a277)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:51.011475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:51.059465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ffe641a0d624981aef84cfcf028a277'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.067758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ffe641a0d624981aef84cfcf028a277'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.068375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ffe641a0d624981aef84cfcf028a277'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.068984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ffe641a0d624981aef84cfcf028a277'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.081334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ffe641a0d624981aef84cfcf028a277'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.097418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1053/2114] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:50 2022] DELETE /identity/v3/users/7ffe641a0d624981aef84cfcf028a277 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:51.102372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.102887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.102887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.121130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:51.122348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.187965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1062/2115] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:51.197756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.199236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.215940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:51.261471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f793e8e-4560-45d1-8949-66e8eb1b4676 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.267862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:51.268896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.269266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.269713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.285248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:51.287509 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:51.300474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1054/2116] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:51.666034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.667616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.680254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e757c02-b95d-40ea-b470-cff42e1ee0c8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.686843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:51.688976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.688976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.689197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] PATH_INFO: `/v3/projects/f2fe9e619bcc4c739bfce2a2a1325841` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.690543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2fe9e619bcc4c739bfce2a2a1325841)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:51.692672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:51.726903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.729623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.744676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707fe1e9-a8c7-470a-acef-1b10d573035e service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.752265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:51.757952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2fe9e619bcc4c739bfce2a2a1325841', 'request_id': 'req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.769834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2fe9e619bcc4c739bfce2a2a1325841', 'request_id': 'req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.779630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2fe9e619bcc4c739bfce2a2a1325841', 'request_id': 'req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.792847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] The token cache is being invalidate because project f2fe9e619bcc4c739bfce2a2a1325841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:51.793149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.793786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d05990f6-9f03-402d-ba5b-0e9a6d01aaa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.796074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1063/2117] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:51 2022] DELETE /identity/v3/projects/f2fe9e619bcc4c739bfce2a2a1325841 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:51.802371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff22e-ea06-44ca-ac90-b07b44b30f31 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.802371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff22e-ea06-44ca-ac90-b07b44b30f31 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.802371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9ff22e-ea06-44ca-ac90-b07b44b30f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.819735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:51.820510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.820756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.821028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] PATH_INFO: `/v3/users/7043693253ba41ee948c89823c9b723a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.822283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7043693253ba41ee948c89823c9b723a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:51.834549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fe9ff22e-ea06-44ca-ac90-b07b44b30f31 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:51.835322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:51.836434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fe9ff22e-ea06-44ca-ac90-b07b44b30f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.853181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1064/2118] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:51.861545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.861838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.862113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.886192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:51.887731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.898963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1065/2119] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:51.901922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7043693253ba41ee948c89823c9b723a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.904470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.914198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca804b8d-1a6f-4adf-901a-be2a296b7502 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.917376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7043693253ba41ee948c89823c9b723a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.918093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7043693253ba41ee948c89823c9b723a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.919591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7043693253ba41ee948c89823c9b723a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.920136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:51.921173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.921173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.921594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.922576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:51.922895 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:51.924708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:51.937500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9c50345b-e61e-4599-b136-7c039092ba12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7043693253ba41ee948c89823c9b723a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:51.951160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1066/2120] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:51.952351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:51.952753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1055/2121] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:51 2022] DELETE /identity/v3/users/7043693253ba41ee948c89823c9b723a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:51.957063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:51.957424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:51.957985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:51.958122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:51.973000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee9de0-36a3-4b07-96c1-914b69b4dfad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:51.977112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:51.979011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.013378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:52.042163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.042853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.043136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.043408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.044213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.046259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.059325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1056/2122] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:52.071536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.074455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.083203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1067/2123] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:51 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:52.084883 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.145787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338a5e-d368-4531-b570-59a3b29d9bf5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.155141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de759c8f-8ce1-4c3e-bcb9-4db17f7de04e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.160032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.160835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.161225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.161475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.162189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.164445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.200569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1068/2124] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:52 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:52.203113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.206958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.208075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.208381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.208721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.214542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae156dc7-7347-4fb7-978c-25b618722abb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.218736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.220201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.220388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.221027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.221334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.221586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.222551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.225992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.232795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1057/2125] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:52.243718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1069/2126] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:52.248405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.258404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54d9272-1bd4-4ce3-bfd4-5c243802e6dd service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.263748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.264464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.264738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.265004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.265742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.267350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ef726-6634-4679-a0e5-4781b275a04e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.278261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1058/2127] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:52.282732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.294300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a75737-9bcc-48ee-935f-cac7aa8c8224 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.299501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.300449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.300730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.301000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] PATH_INFO: `/v3/projects/c96f4f80148e445fbab00adcb7fb3cf9/users/82bb721a04e34ab2afd851403be82698/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.304868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:52.319579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96f4f80148e445fbab00adcb7fb3cf9, user_id=82bb721a04e34ab2afd851403be82698, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.322485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.340046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1070/2128] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:52 2022] PUT /identity/v3/projects/c96f4f80148e445fbab00adcb7fb3cf9/users/82bb721a04e34ab2afd851403be82698/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:52.350387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.350672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.350958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.381588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] MFA Rules not processed for user `82bb721a04e34ab2afd851403be82698`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:52.382959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.448912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1059/2129] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:52.461983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.466544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.521556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.523077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.539252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:52.540463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56339323-7fda-436e-9d38-64cf40cbf786 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.549267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.550004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.550599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.551170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.560702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.562285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.571491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1071/2130] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:52.599744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.611226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd7159-599a-4015-b119-2fd510597c4d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.612949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699286a-a883-49a4-8928-76567a245a34 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.618751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.619697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.620005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.620307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] PATH_INFO: `/v3/users/82bb721a04e34ab2afd851403be82698` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.622649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82bb721a04e34ab2afd851403be82698)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.623724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.624624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.624739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.625096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.625434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] PATH_INFO: `/v3/projects/c52bead68b4d4de0b1c7b13221051218` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.626738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c52bead68b4d4de0b1c7b13221051218)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.628773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.676138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82bb721a04e34ab2afd851403be82698'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.680149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c52bead68b4d4de0b1c7b13221051218', 'request_id': 'req-94223792-d922-4dbb-84db-036a22f855ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.687897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82bb721a04e34ab2afd851403be82698'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.691521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c52bead68b4d4de0b1c7b13221051218', 'request_id': 'req-94223792-d922-4dbb-84db-036a22f855ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.697453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c52bead68b4d4de0b1c7b13221051218', 'request_id': 'req-94223792-d922-4dbb-84db-036a22f855ce'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.701134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82bb721a04e34ab2afd851403be82698'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.701852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82bb721a04e34ab2afd851403be82698'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.702469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c6e17cdd-406b-43f2-b155-51b49b0d3816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82bb721a04e34ab2afd851403be82698'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.710084 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] The token cache is being invalidate because project c52bead68b4d4de0b1c7b13221051218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:52.710306 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.711147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.713042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1060/2131] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:52 2022] DELETE /identity/v3/projects/c52bead68b4d4de0b1c7b13221051218 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:52.717271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1072/2132] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:52 2022] DELETE /identity/v3/users/82bb721a04e34ab2afd851403be82698 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:52.717902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.718676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f421-ace8-4b32-9c80-758a0393cec6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.718977 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f421-ace8-4b32-9c80-758a0393cec6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.719252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6f421-ace8-4b32-9c80-758a0393cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.719331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.740267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-68c6f421-ace8-4b32-9c80-758a0393cec6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:52.741617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-68c6f421-ace8-4b32-9c80-758a0393cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.789684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94223792-d922-4dbb-84db-036a22f855ce admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.796263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:52.806320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1073/2133] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:52.808102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ac8f-6533-48fa-81ff-f7e79dea56d1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.808660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ac8f-6533-48fa-81ff-f7e79dea56d1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.809401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51ac8f-6533-48fa-81ff-f7e79dea56d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.829968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0d51ac8f-6533-48fa-81ff-f7e79dea56d1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:52.831173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0d51ac8f-6533-48fa-81ff-f7e79dea56d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.839606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1074/2134] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:52.840838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.841117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.841398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.850182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:52.861277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.862310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.862492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.864477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] PATH_INFO: `/v3/users/bf7b316f86924d9ebfa63612e54c7888` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.867133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7b316f86924d9ebfa63612e54c7888)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:52.868097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:52.869445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.870270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:52.878953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1075/2135] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:52.879725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.882475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.925253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7b316f86924d9ebfa63612e54c7888'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.937395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7b316f86924d9ebfa63612e54c7888'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.938221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7b316f86924d9ebfa63612e54c7888'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.939235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7b316f86924d9ebfa63612e54c7888'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.963014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7b316f86924d9ebfa63612e54c7888'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:52.968406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c09743-f152-4035-97c5-f35ec27474f1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:52.977504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:52.978197 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:52.978651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:52.979421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:52.979542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1061/2136] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:05:52 2022] DELETE /identity/v3/users/bf7b316f86924d9ebfa63612e54c7888 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:52.982630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:52.982630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:52.984031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.001771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.004586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b1e2d-d37e-483a-b949-1485ff0a785b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.018584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1076/2137] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:53.021363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.024522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.025031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.054844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:53.055095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e73310-9cfd-4441-b506-1cba0c19f212 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.056654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.060375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.061074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.061355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.061631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.062674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:53.063088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.065297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.066566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1077/2138] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:53.077231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.079038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.086459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1062/2139] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:05:53.091682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.104035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053144f6-d036-492c-a453-82058ca11cd9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.109944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.110675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.111033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.111308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.112042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.114007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.148317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1063/2140] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:53.149637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.155199 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f104e3f5-e0ae-4395-8e77-8ac0b7a5d318 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.217109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:53.225251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.226075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.226360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.226630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.244017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a856f4-89f9-4394-b275-41a836245356 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.250693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.252596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.253393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.253840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.254753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.257959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.294601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1064/2141] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:53.303850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.307304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:53.317931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52307147-9452-43be-a93e-c66087cb2f3c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.323898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.324703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.324985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.325376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.326191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.327847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.328174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.329882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.340817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1065/2142] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:53.346301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.347946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1078/2143] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:53.349371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.350991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.371877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52949e1b-09f4-4440-b3b5-527997b40e71 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.373789 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a6615-adbb-455a-a3ac-174b6da3e5de service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.377759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.378448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.378736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.379173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.379994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.381048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.381672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.382409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.382694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.382963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] PATH_INFO: `/v3/projects/c96f4f80148e445fbab00adcb7fb3cf9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.384258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96f4f80148e445fbab00adcb7fb3cf9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.386254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.394565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1066/2144] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:53.399036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.413589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f23ff-3e4b-465a-823f-bb1379d9e026 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.419149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.420889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.421350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.421942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] PATH_INFO: `/v3/projects/13b48b4ba5fa4165988dfca98d63787e/users/57b50d61658b4413ad805393c3c536bb/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.443464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b48b4ba5fa4165988dfca98d63787e, user_id=57b50d61658b4413ad805393c3c536bb, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.446486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a919cb-251c-48d6-bd9d-22084bfedea9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.451940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96f4f80148e445fbab00adcb7fb3cf9', 'request_id': 'req-f2f8f719-eb4a-40b8-a492-a654913a8c40'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.459445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96f4f80148e445fbab00adcb7fb3cf9', 'request_id': 'req-f2f8f719-eb4a-40b8-a492-a654913a8c40'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.463854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1067/2145] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:53 2022] PUT /identity/v3/projects/13b48b4ba5fa4165988dfca98d63787e/users/57b50d61658b4413ad805393c3c536bb/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:53.476040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.476323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.476641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.479354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96f4f80148e445fbab00adcb7fb3cf9', 'request_id': 'req-f2f8f719-eb4a-40b8-a492-a654913a8c40'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.491662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] The token cache is being invalidate because project c96f4f80148e445fbab00adcb7fb3cf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:53.492245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.493074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.494958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1079/2146] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:53 2022] DELETE /identity/v3/projects/c96f4f80148e445fbab00adcb7fb3cf9 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:53.506955 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] MFA Rules not processed for user `57b50d61658b4413ad805393c3c536bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:53.508937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.608337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1068/2147] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:53.613171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.615087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.688194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.689717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.719569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f719-eb4a-40b8-a492-a654913a8c40 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.775633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762872-d1e4-4ed9-8bca-77a5d40baf65 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.780312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.781194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.781473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.781764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] PATH_INFO: `/v3/projects/e112312d1baf4b8c93d31da59033a26d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.783038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e112312d1baf4b8c93d31da59033a26d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.784460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.785001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.785161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.785406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.785708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.786614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.788546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.801725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:53.821509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1080/2148] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:05:53.822520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.827869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:53.839182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e112312d1baf4b8c93d31da59033a26d', 'request_id': 'req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.847208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e112312d1baf4b8c93d31da59033a26d', 'request_id': 'req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.853139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e112312d1baf4b8c93d31da59033a26d', 'request_id': 'req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.866283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] The token cache is being invalidate because project e112312d1baf4b8c93d31da59033a26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:05:53.866582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.867311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-208f02ff-6f4b-47e7-869b-e2c6ea2fcdd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:05:53.868984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1069/2149] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:05:53 2022] DELETE /identity/v3/projects/e112312d1baf4b8c93d31da59033a26d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:53.873810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2eed-a2bf-428d-bfdb-09bb2a80c26e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.874170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2eed-a2bf-428d-bfdb-09bb2a80c26e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.874373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff2eed-a2bf-428d-bfdb-09bb2a80c26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.890395 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4bfc8-78c9-4ca7-914b-8887e523b613 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.894094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c9ff2eed-a2bf-428d-bfdb-09bb2a80c26e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:53.895442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c9ff2eed-a2bf-428d-bfdb-09bb2a80c26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.950979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:53.951670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.951945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.952341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.953150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:53.955083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:53.959194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1070/2150] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:05:53.967426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:53.967715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:53.968263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:53.977983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1081/2151] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:53.981924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:53.983580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.987490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:53.988725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:53.995019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fa925-56d1-4497-a97c-1be6e44c450b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:53.996804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1071/2152] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:54.000069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.000756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.000941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.001043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.001503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.002353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.004553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.010237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d4f82-2738-48fb-8abc-62ad6c7a45d2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.018302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1082/2153] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:54.018443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.018443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.018443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.018443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.018799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:05:54.018799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.019351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.019733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.028915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb18987-92c8-44b9-8621-f5b10a9bde77 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.031998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1072/2154] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:05:54.033745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.034478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.034755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.035021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.035800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.036324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.037489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.046369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e91c-4ac4-48d5-b2f2-da4369a74984 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.051759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.052740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.053243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.053715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.054414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.055714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1083/2155] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:54.056869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.059919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.071471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891367a-5b56-46ec-8804-a199887a42f0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.078679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.081770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.082064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.082332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] PATH_INFO: `/v3/projects/16a028534d0641d2ae81ba563a140ff2/users/93c97e4fa0ff4991b87f6d7e801c52e2/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.091407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1073/2156] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:54.095889 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.100631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a028534d0641d2ae81ba563a140ff2, user_id=93c97e4fa0ff4991b87f6d7e801c52e2, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.103303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c0856-1ad2-4662-9017-830418945d8a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.119643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1084/2157] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:54 2022] PUT /identity/v3/projects/16a028534d0641d2ae81ba563a140ff2/users/93c97e4fa0ff4991b87f6d7e801c52e2/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:54.130311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.130646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.131172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.164160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] MFA Rules not processed for user `93c97e4fa0ff4991b87f6d7e801c52e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:54.164794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.181237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412bea3-d209-4bb5-9136-90a1d08c6657 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.190508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:54.220046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:54.242081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1085/2158] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:54.246733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.247036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.247430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.247708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.247976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.248715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.250650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.258914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c4ed1-5a3d-4b86-86dd-6f14a5fc6a40 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.264367 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.265129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.265404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.265668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.266358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.268606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.272213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1074/2159] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:54.276262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.286979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84fb66-b13d-4b42-804b-9702eed01647 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.294999 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1086/2160] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:54.295538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.296255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.296525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.296792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.297531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.299133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.299237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.311160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1075/2161] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:54.315130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.330639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5bec0-0e03-454a-a9de-3c97f7b4021e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.377629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8e8a5-a90a-4579-b722-06ed0676db6c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.382606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.383302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.383583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.383850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.384585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.386515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.395374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.396216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.396577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.396849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.397983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.399981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.408892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1087/2162] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/users => generated 299 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:05:54.411561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1076/2163] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:05:54.412907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.415702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.422666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d1290-f6a3-4d19-b009-5a55e7cd52d6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.425642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5334cb47-7732-4bca-acd4-e5deb8496f24 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.427303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.427980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.428293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.428574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.429322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.430831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.430987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.431658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.431936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.432305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] PATH_INFO: `/v3/projects/c4a4ec8aa88c47d29d3f968f3a70a296/users/1fa7484ebd7e45eba2a29ab1091a8321/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.445278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1088/2164] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:54.446358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.452233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a4ec8aa88c47d29d3f968f3a70a296, user_id=1fa7484ebd7e45eba2a29ab1091a8321, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.454947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca86a47-231f-423b-9c98-6acc823c3222 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.456010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac33cee5-d1bf-4e5d-855e-fdf92d8e9b7d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.462371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.463705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.464045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.464919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] PATH_INFO: `/v3/projects/96d847a773de4e0e93dddf8747c081ec/users/b60ad9bc218c4e8698aee1c35394c1d0/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.470077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1077/2165] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:54 2022] PUT /identity/v3/projects/c4a4ec8aa88c47d29d3f968f3a70a296/users/1fa7484ebd7e45eba2a29ab1091a8321/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:54.480752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d847a773de4e0e93dddf8747c081ec, user_id=b60ad9bc218c4e8698aee1c35394c1d0, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.481824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.482139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.482409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.483441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.501668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1089/2166] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:54 2022] PUT /identity/v3/projects/96d847a773de4e0e93dddf8747c081ec/users/b60ad9bc218c4e8698aee1c35394c1d0/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:05:54.503881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.512253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] MFA Rules not processed for user `1fa7484ebd7e45eba2a29ab1091a8321`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:54.513810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.565612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:54.565824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756a3dd-b3f4-46f0-8495-8540a38262e8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.571394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.572189 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.572512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.573024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.573807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.576583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.588387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1078/2167] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:54.590608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1090/2168] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:05:54.594964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.600112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.601842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.605897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45626097-1441-4416-9c0b-c2a5a6623347 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.611111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.612056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.612371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.612655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] PATH_INFO: `/v3/projects/96d847a773de4e0e93dddf8747c081ec/users/b60ad9bc218c4e8698aee1c35394c1d0/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.614727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96d847a773de4e0e93dddf8747c081ec, user_id=b60ad9bc218c4e8698aee1c35394c1d0, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.617456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2713e295-37f7-458b-933b-d3958674d033 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.619683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:05:54.628758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1079/2169] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:05:54 2022] PUT /identity/v3/projects/96d847a773de4e0e93dddf8747c081ec/users/b60ad9bc218c4e8698aee1c35394c1d0/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:05:54.639193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.639472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.639741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.666678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] MFA Rules not processed for user `b60ad9bc218c4e8698aee1c35394c1d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:05:54.667900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.668285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31889574-175d-41d6-a08d-8201e7a329b0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.725905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.726571 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.726851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.727112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.744148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1080/2170] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:05:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:05:54.752992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:54.754386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.768134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5207c-1372-41dd-ab41-f2c86bc60757 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:54.771926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:54.772616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:54.772891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:54.773161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:54.775056 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:05:54.794590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.796772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.807217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1091/2171] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:05:54.841550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:54.843020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:54.852372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1081/2172] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:58.489963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:58.499037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8f33-7511-49ce-8a7d-7bc35800c972 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:58.503139 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:58.503810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:58.504084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:58.504381 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:58.568306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:58.569813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:58.579064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1092/2173] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:05:59.163192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:05:59.172590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e2fb2-13a4-4b0b-ab64-6464f790a838 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:05:59.177204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:05:59.177845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:05:59.178113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:05:59.178367 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:05:59.188282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:05:59.189718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941b07f-39af-46ef-bfb2-53ac25848a49 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:05:59.199416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1082/2174] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:05:59 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:04.268932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:04.294489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:04.334333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d78bd4-ed7e-4376-9c8b-a3526e735638 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:04.339231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:04.340137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:04.340424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:04.340692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] PATH_INFO: `/v3/users/57b50d61658b4413ad805393c3c536bb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:04.342022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57b50d61658b4413ad805393c3c536bb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:04.343997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:04.401870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57b50d61658b4413ad805393c3c536bb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:04.422790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57b50d61658b4413ad805393c3c536bb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:04.436491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57b50d61658b4413ad805393c3c536bb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:04.437162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57b50d61658b4413ad805393c3c536bb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:04.437854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57b50d61658b4413ad805393c3c536bb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:04.450016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1093/2175] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:06:04 2022] DELETE /identity/v3/users/57b50d61658b4413ad805393c3c536bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:04.454724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:04.455178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:04.455395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:04.473803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:04.475047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:04.523590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:04.544649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1083/2176] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:04.554461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:04.556084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:04.617003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a5225-fabf-4c2b-8263-a6765514c2b4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:04.621596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:04.622458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:04.622907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:04.623344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:04.633956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:04.635538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:04.646205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1094/2177] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:06:04.956610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:04.958494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:04.971125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d92dd16-314e-4034-a21a-9b22b8c195a5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:04.976556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:04.977405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:04.977679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:04.977960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] PATH_INFO: `/v3/projects/13b48b4ba5fa4165988dfca98d63787e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:04.979159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b48b4ba5fa4165988dfca98d63787e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:04.981170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:05.031417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b48b4ba5fa4165988dfca98d63787e', 'request_id': 'req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.040622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b48b4ba5fa4165988dfca98d63787e', 'request_id': 'req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.046418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b48b4ba5fa4165988dfca98d63787e', 'request_id': 'req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.057418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] The token cache is being invalidate because project 13b48b4ba5fa4165988dfca98d63787e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:06:05.057697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.058318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.059897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1084/2178] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:06:04 2022] DELETE /identity/v3/projects/13b48b4ba5fa4165988dfca98d63787e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:05.064148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:05.074330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e126809-8081-419c-8e26-340b95529944 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:05.117237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:05.134991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:05.135954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:05.136235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:05.136524 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] PATH_INFO: `/v3/users/93c97e4fa0ff4991b87f6d7e801c52e2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:05.137775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c97e4fa0ff4991b87f6d7e801c52e2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:05.139710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:05.186834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c97e4fa0ff4991b87f6d7e801c52e2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.194777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c97e4fa0ff4991b87f6d7e801c52e2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.207015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c97e4fa0ff4991b87f6d7e801c52e2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.208016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c97e4fa0ff4991b87f6d7e801c52e2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.208670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c97e4fa0ff4991b87f6d7e801c52e2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.220970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1095/2179] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:06:05 2022] DELETE /identity/v3/users/93c97e4fa0ff4991b87f6d7e801c52e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:05.546534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:05.548167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:05.561521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4e7a8-9ff2-46a7-b450-552f2982b5a3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:05.622558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:05.623686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:05.623686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:05.623981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] PATH_INFO: `/v3/projects/16a028534d0641d2ae81ba563a140ff2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:05.625288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a028534d0641d2ae81ba563a140ff2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:05.627201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:05.675015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a028534d0641d2ae81ba563a140ff2', 'request_id': 'req-56a39100-06e0-496e-8a32-ce63cd599f66'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.683859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a028534d0641d2ae81ba563a140ff2', 'request_id': 'req-56a39100-06e0-496e-8a32-ce63cd599f66'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.689972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a028534d0641d2ae81ba563a140ff2', 'request_id': 'req-56a39100-06e0-496e-8a32-ce63cd599f66'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.700941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] The token cache is being invalidate because project 16a028534d0641d2ae81ba563a140ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:06:05.701223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.701859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.703526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1085/2180] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:06:05 2022] DELETE /identity/v3/projects/16a028534d0641d2ae81ba563a140ff2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:05.707994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:05.709729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:05.727836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fef7d1-05b9-4c16-8bbf-0a3de680d117 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:05.785909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:05.786695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:05.786964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:05.787231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] PATH_INFO: `/v3/users/b60ad9bc218c4e8698aee1c35394c1d0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:05.788497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b60ad9bc218c4e8698aee1c35394c1d0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:05.790415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:05.843204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b60ad9bc218c4e8698aee1c35394c1d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.852318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b60ad9bc218c4e8698aee1c35394c1d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.860783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:05.865750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b60ad9bc218c4e8698aee1c35394c1d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.866992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b60ad9bc218c4e8698aee1c35394c1d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.868044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-06f19d12-c61b-41ae-ba24-c22060105168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b60ad9bc218c4e8698aee1c35394c1d0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:05.881221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1096/2181] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:06:05 2022] DELETE /identity/v3/users/b60ad9bc218c4e8698aee1c35394c1d0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:06.176504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.177970 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:06.186543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:06.192404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a39100-06e0-496e-8a32-ce63cd599f66 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.254590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.255465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.255741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.256013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] PATH_INFO: `/v3/projects/96d847a773de4e0e93dddf8747c081ec` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.257901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96d847a773de4e0e93dddf8747c081ec)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.259819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.308060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96d847a773de4e0e93dddf8747c081ec', 'request_id': 'req-29b64380-2d04-433b-9800-9054d51e7800'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:06.316021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96d847a773de4e0e93dddf8747c081ec', 'request_id': 'req-29b64380-2d04-433b-9800-9054d51e7800'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:06.321959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96d847a773de4e0e93dddf8747c081ec', 'request_id': 'req-29b64380-2d04-433b-9800-9054d51e7800'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:06.335961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] The token cache is being invalidate because project 96d847a773de4e0e93dddf8747c081ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:06:06.336348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:06.336999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-29b64380-2d04-433b-9800-9054d51e7800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:06.338855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1086/2182] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:06:06 2022] DELETE /identity/v3/projects/96d847a773de4e0e93dddf8747c081ec => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:06.345000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.345354 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.345561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.364499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:06.365545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:06.430578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1097/2183] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:06.500938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.501219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.501487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.521074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:06.522324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:06.530765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1087/2184] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:06.535146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.545286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14111-b618-48f3-92d3-0cbc52104b38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.550308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.550965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.551241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.551513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.552264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:06:06.552563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.554176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.566519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1098/2185] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:06:06.570685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.580532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25ca9-d7c8-417b-80e0-f729afc65b9b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.585787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.586435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.586708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.586972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.587671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.589578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.617391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1088/2186] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:06:06 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:06:06.621646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.632264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4cc73-2d6a-4e8d-b6ba-ba2bfe1c7638 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.692953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.693661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.693937 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.694207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.694915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.696901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.719261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1099/2187] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:06:06 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:06:06.723573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.734654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862a322-878a-4e44-9c6c-647be7bc27c8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.740092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.740959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.741216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.741545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.742394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.744331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.756570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1089/2188] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:06:06.760488 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.771190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871654b-3220-4e37-95f3-a2c4fdb98bb7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.776577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.777282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.777575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.777836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.778566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.780183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97430a07-3d0d-4201-a8d3-b77974d53e37 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.790847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1100/2189] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:06:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:06:06.795101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.805467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f32310-554e-4c2d-82e8-711f1016f953 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:06.809924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:06.810807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.811080 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.811343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] PATH_INFO: `/v3/projects/9dcc3e1fbb7a42a2b973d238ae848e60/users/48264ad5ef154a039b6dbe27875db1e8/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.827629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcc3e1fbb7a42a2b973d238ae848e60, user_id=48264ad5ef154a039b6dbe27875db1e8, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:06.830381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:06.848622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1090/2190] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:06:06 2022] PUT /identity/v3/projects/9dcc3e1fbb7a42a2b973d238ae848e60/users/48264ad5ef154a039b6dbe27875db1e8/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:06.859162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231d75-c00e-4f1b-9039-ed2114601ac5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:06.859451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231d75-c00e-4f1b-9039-ed2114601ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:06.859712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5231d75-c00e-4f1b-9039-ed2114601ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:06.886935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e5231d75-c00e-4f1b-9039-ed2114601ac5 None None] MFA Rules not processed for user `48264ad5ef154a039b6dbe27875db1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:06.888254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e5231d75-c00e-4f1b-9039-ed2114601ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:06.927064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:06.956582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1101/2191] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:06.968591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:06.970671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:07.003380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:07.031980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b31321-3b55-4fff-b98c-b9cd59087c38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:07.035635 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:07.036336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:07.036612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:07.036884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:07.045196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:07.046628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:07.055589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1091/2192] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:11.178715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb801f-daa0-43cd-9916-782c6def7b70 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:11.179512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb801f-daa0-43cd-9916-782c6def7b70 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:11.179660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb801f-daa0-43cd-9916-782c6def7b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:11.210262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-97eb801f-daa0-43cd-9916-782c6def7b70 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:11.211629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97eb801f-daa0-43cd-9916-782c6def7b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:11.281547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1102/2193] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:11.307293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:11.308806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:11.402397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b05503-44f0-4068-a57e-fa6dd870c1cf service glance] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:11.408730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:11.409392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:11.409663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:11.409934 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:11.419042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:11.420656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:11.431544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1092/2194] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:16.303577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8d5e-42c8-4ecb-9881-454c00f24be9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:16.304144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8d5e-42c8-4ecb-9881-454c00f24be9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:16.304144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9e8d5e-42c8-4ecb-9881-454c00f24be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:16.323316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5f9e8d5e-42c8-4ecb-9881-454c00f24be9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:16.324551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5f9e8d5e-42c8-4ecb-9881-454c00f24be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:16.333561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1103/2195] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:16.359496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:16.371208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1208527-9986-44b9-a3e6-1e036fe5503f service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:16.377774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:16.378423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:16.378701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:16.378971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:16.387854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:16.389596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:16.400363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1093/2196] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:20.615538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f09b-ada2-4eed-9543-fc572aad2c14 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:20.616092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f09b-ada2-4eed-9543-fc572aad2c14 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:20.616092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668f09b-ada2-4eed-9543-fc572aad2c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:20.693585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8668f09b-ada2-4eed-9543-fc572aad2c14 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:20.694802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8668f09b-ada2-4eed-9543-fc572aad2c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:20.751882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1104/2197] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:20.784031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:20.826514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2e76c-8a23-4c32-b384-d610389597c1 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:20.834444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:20.835127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:20.835523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:20.835785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:20.845257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:20.846851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:20.856766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1094/2198] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:25.832920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf201-b245-456c-9ea0-067e8da8ddf1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:25.833359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf201-b245-456c-9ea0-067e8da8ddf1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:25.833616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf201-b245-456c-9ea0-067e8da8ddf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:25.853461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cbecf201-b245-456c-9ea0-067e8da8ddf1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:25.854706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cbecf201-b245-456c-9ea0-067e8da8ddf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:25.863388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1105/2199] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:25.889137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:25.900395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b554fa88-b278-4e84-a799-ee060b130eee service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:25.906081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:25.906740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:25.907012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:25.907275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:25.916223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:25.917820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:25.927661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1095/2200] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:35.848233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=84 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:35.923238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=79 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:36.146078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaeda0-8061-4229-b5a2-11f4a0878c8b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:36.146552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaeda0-8061-4229-b5a2-11f4a0878c8b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:36.147048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeaeda0-8061-4229-b5a2-11f4a0878c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:36.184096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-feeaeda0-8061-4229-b5a2-11f4a0878c8b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:36.185326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-feeaeda0-8061-4229-b5a2-11f4a0878c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:36.193682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1106/2201] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:36.215743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:36.217518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:36.246298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca5d0b-aa59-401d-88f3-c62f22fa5b0d service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:36.253436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:36.254094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:36.254369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:36.254639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:36.263952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:36.265599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:36.276110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1096/2202] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:44.459965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096db2-5330-475d-9c5a-eaa365e0b0bb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:44.460845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096db2-5330-475d-9c5a-eaa365e0b0bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:44.461279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53096db2-5330-475d-9c5a-eaa365e0b0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:44.482642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-53096db2-5330-475d-9c5a-eaa365e0b0bb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:44.484158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-53096db2-5330-475d-9c5a-eaa365e0b0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:44.493749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1107/2203] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:44.515966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:44.548459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0d9-706d-4aa7-8320-0da3b931ad97 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:44.555557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:44.556546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:44.556785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:44.557324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:44.567088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:44.568911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:44.581004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1097/2204] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:45.352014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33501b-f7e4-4e3a-82ff-0d7972dddb5f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:45.352325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33501b-f7e4-4e3a-82ff-0d7972dddb5f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:45.352600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33501b-f7e4-4e3a-82ff-0d7972dddb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:45.374807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db33501b-f7e4-4e3a-82ff-0d7972dddb5f None None] MFA Rules not processed for user `26ce1c1b87eb441bb883c639c92339d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:45.376017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db33501b-f7e4-4e3a-82ff-0d7972dddb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:45.436137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1108/2205] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:47.936642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:47.938630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:47.952641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202b610-1f63-4267-a0c0-5302d1203e25 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:47.958831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:47.959803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:47.960182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:47.960610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] PATH_INFO: `/v3/users/1fa7484ebd7e45eba2a29ab1091a8321` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:47.962015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa7484ebd7e45eba2a29ab1091a8321)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:47.964083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:48.013375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa7484ebd7e45eba2a29ab1091a8321'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.021487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa7484ebd7e45eba2a29ab1091a8321'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.022255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa7484ebd7e45eba2a29ab1091a8321'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.023044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa7484ebd7e45eba2a29ab1091a8321'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.035785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa7484ebd7e45eba2a29ab1091a8321'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.048636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1098/2206] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:06:47 2022] DELETE /identity/v3/users/1fa7484ebd7e45eba2a29ab1091a8321 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:48.053325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:48.053839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:48.053839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:48.072736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:48.074071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:48.138587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1109/2207] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:48.148407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:48.149921 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:48.236491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401c1aa-e3ff-4310-aafe-ffee20eadd03 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:48.240575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:48.242042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:48.242042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:48.242042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:48.253048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:48.254897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:48.265901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1099/2208] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:06:48.647376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:48.649034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:48.671620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a59745-284b-4d81-843d-78a1c755de2c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:48.680628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:48.684210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:48.685096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:48.685806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] PATH_INFO: `/v3/projects/c4a4ec8aa88c47d29d3f968f3a70a296` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:48.687456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a4ec8aa88c47d29d3f968f3a70a296)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:48.689478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:48.747688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a4ec8aa88c47d29d3f968f3a70a296', 'request_id': 'req-7a6dca00-e268-4e83-8ad1-9db5cecf6660'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.755494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a4ec8aa88c47d29d3f968f3a70a296', 'request_id': 'req-7a6dca00-e268-4e83-8ad1-9db5cecf6660'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.765245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a4ec8aa88c47d29d3f968f3a70a296', 'request_id': 'req-7a6dca00-e268-4e83-8ad1-9db5cecf6660'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.778022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] The token cache is being invalidate because project c4a4ec8aa88c47d29d3f968f3a70a296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:06:48.778461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.779220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a6dca00-e268-4e83-8ad1-9db5cecf6660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:48.781604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1110/2209] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:06:48 2022] DELETE /identity/v3/projects/c4a4ec8aa88c47d29d3f968f3a70a296 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:50.840431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:50.842187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:50.851993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:50.856366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfadf8a-3eb5-4036-80a1-cb0258cc78de service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:50.915607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:50.916538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:50.916826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:50.917104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] PATH_INFO: `/v3/users/48264ad5ef154a039b6dbe27875db1e8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:50.918345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48264ad5ef154a039b6dbe27875db1e8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:50.920301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:50.975274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48264ad5ef154a039b6dbe27875db1e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:50.984484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48264ad5ef154a039b6dbe27875db1e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:50.985029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48264ad5ef154a039b6dbe27875db1e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:50.985738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48264ad5ef154a039b6dbe27875db1e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:50.999022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48264ad5ef154a039b6dbe27875db1e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.011836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1100/2210] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:06:50 2022] DELETE /identity/v3/users/48264ad5ef154a039b6dbe27875db1e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:06:51.016436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:51.016972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:51.016972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:51.030433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:06:51.036596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:06:51.037846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:51.119259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1111/2211] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:06:51.129395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:51.130754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:51.195197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6999-5172-4ead-9b2b-7804ba8a96e3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:51.199060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:51.204292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:51.204571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:51.204863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:51.216703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:51.218200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:51.228443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1101/2212] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:06:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:06:51.547347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:06:51.549097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:06:51.562350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994477d-746c-4e00-a1cf-deb7c971b237 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:06:51.567984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:06:51.568901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:06:51.569179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:06:51.569444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] PATH_INFO: `/v3/projects/9dcc3e1fbb7a42a2b973d238ae848e60` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:06:51.570679 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcc3e1fbb7a42a2b973d238ae848e60)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:06:51.572645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:06:51.620906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcc3e1fbb7a42a2b973d238ae848e60', 'request_id': 'req-90bc495a-4042-426e-b837-b3569eccf65d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.627012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcc3e1fbb7a42a2b973d238ae848e60', 'request_id': 'req-90bc495a-4042-426e-b837-b3569eccf65d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.636601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcc3e1fbb7a42a2b973d238ae848e60', 'request_id': 'req-90bc495a-4042-426e-b837-b3569eccf65d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.646885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] The token cache is being invalidate because project 9dcc3e1fbb7a42a2b973d238ae848e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:06:51.647167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.647804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-90bc495a-4042-426e-b837-b3569eccf65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:06:51.649473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1112/2213] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:06:51 2022] DELETE /identity/v3/projects/9dcc3e1fbb7a42a2b973d238ae848e60 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:07:01.223809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=77,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:01.643926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:01.830197 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:01.832096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:01.933374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ff712-9d76-4af8-bcc6-29201ae15210 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:01.998445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:01.999106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:01.999446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:01.999663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:02.001633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:02.013724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:02.015329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36f86d-2fc7-456c-9d58-7a182f45c267 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:02.025719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1102/2214] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:06.732479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:06.733002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:06.733002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:06.752692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] MFA Rules not processed for user `fee14e4c35544359b6b01797e1620ced`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:06.754157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:06.810562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1113/2215] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:07:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:07:12.021713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=67 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:16.803842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=25 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:23.782323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2df-c130-4a63-9bf9-c3255d591382 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:23.782901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2df-c130-4a63-9bf9-c3255d591382 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:23.782901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8bc2df-c130-4a63-9bf9-c3255d591382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:23.801857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bc8bc2df-c130-4a63-9bf9-c3255d591382 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:23.803055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bc8bc2df-c130-4a63-9bf9-c3255d591382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:23.865887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1103/2216] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:07:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:07:23.889427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:23.890967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:23.986134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef3389-bbbb-4e9b-bff6-ff7265edff62 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:23.992097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:23.992783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:23.993068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:23.993333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:24.002138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:24.003742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:24.013625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1114/2217] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:28.103631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeded0-6b69-4ac2-b747-2f7bd4aa0e16 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:28.104261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeded0-6b69-4ac2-b747-2f7bd4aa0e16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:28.104369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbeded0-6b69-4ac2-b747-2f7bd4aa0e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:28.124140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1dbeded0-6b69-4ac2-b747-2f7bd4aa0e16 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:28.125364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1dbeded0-6b69-4ac2-b747-2f7bd4aa0e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:28.134844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1104/2218] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:07:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:07:28.181013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:28.182617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:28.198303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00911b6a-f8cf-4fc7-820a-5f49a9c1e03a service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:28.205247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:28.206233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:28.206516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:28.206780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:28.215482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:28.217099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:28.230331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1115/2219] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:32.230098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481ec6-9c46-499e-86cf-b04352199168 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:32.230936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481ec6-9c46-499e-86cf-b04352199168 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:32.231029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da481ec6-9c46-499e-86cf-b04352199168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:32.252212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-da481ec6-9c46-499e-86cf-b04352199168 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:32.253524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-da481ec6-9c46-499e-86cf-b04352199168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:32.264328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1105/2220] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:07:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:07:32.291258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:32.302889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62691ffc-efbe-4730-8bd1-80bc445063f6 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:32.309693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:32.310306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:32.310582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:32.310851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:32.319915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:32.321546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:32.332200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1116/2221] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:37.486430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74df1f-4f1b-4811-a7e8-39a53ad234fe None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:37.487047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74df1f-4f1b-4811-a7e8-39a53ad234fe None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:37.487047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74df1f-4f1b-4811-a7e8-39a53ad234fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:37.506670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3a74df1f-4f1b-4811-a7e8-39a53ad234fe None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:37.507883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3a74df1f-4f1b-4811-a7e8-39a53ad234fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:37.516452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1106/2222] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:07:37.538042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:37.549714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48078d68-3d05-4308-8d74-06a15d3916ea service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:37.556512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:37.557221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:37.557454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:37.557722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:37.567343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:37.569094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:37.579906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1117/2223] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:43.820330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b96b-f2e4-4bed-af15-d1f8796cabe7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:43.821077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b96b-f2e4-4bed-af15-d1f8796cabe7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:43.821077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3b96b-f2e4-4bed-af15-d1f8796cabe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:43.840301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e7f3b96b-f2e4-4bed-af15-d1f8796cabe7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:43.841567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e7f3b96b-f2e4-4bed-af15-d1f8796cabe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:43.849579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1107/2224] 10.222.0.18 () {58 vars in 1016 bytes} [Thu Jul 7 04:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:07:43.873800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:07:43.885816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c3a79c-bea3-4610-a25e-5ab2dddf892b service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:07:43.891457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:07:43.892297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:43.892671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:43.893024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:43.895419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:07:43.895760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:07:43.896038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:07:43.902705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:07:43.903849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08432b20-ef1e-4904-ac8a-99a08aa64012 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:07:43.913716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1118/2225] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:07:43.913925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] MFA Rules not processed for user `82a27d0525d942d99b3c5b19971208dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:07:43.915028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:07:43.978580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1108/2226] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:07:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:07:53.909617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=63 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:07:53.970249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=64 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:15.086707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:15.087225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:15.087225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:15.146583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:15.147785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:15.219547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1119/2227] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:08:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:15.263584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:15.265188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:15.368111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eaad6-103a-4b3d-a8b3-66051243326d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:15.376235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:15.377182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:15.377576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:15.377958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:15.388557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:15.390493 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:15.400877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1109/2228] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:08:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:08:24.932843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:24.932843 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:24.947386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e02f0-894f-4fa7-b424-0179ade91d7b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:24.958741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:24.960174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:24.960469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:24.960740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] PATH_INFO: `/v3/users/fee14e4c35544359b6b01797e1620ced` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:24.963602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee14e4c35544359b6b01797e1620ced)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:24.965581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.017996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee14e4c35544359b6b01797e1620ced'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.027125 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee14e4c35544359b6b01797e1620ced'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.039611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee14e4c35544359b6b01797e1620ced'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.040272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee14e4c35544359b6b01797e1620ced'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.040900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-646677a4-cd67-4a7b-979c-cdf511f250f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee14e4c35544359b6b01797e1620ced'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.053471 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1120/2229] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:08:24 2022] DELETE /identity/v3/users/fee14e4c35544359b6b01797e1620ced => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:08:25.242026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.260284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e6bc0-8506-45e3-9740-56692a050759 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.350093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.350093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.350483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.350587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] PATH_INFO: `/v3/projects/e3c43cec3c1b4a48a4814ae1dd938ffa` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.352032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3c43cec3c1b4a48a4814ae1dd938ffa)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.353992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.416111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3c43cec3c1b4a48a4814ae1dd938ffa', 'request_id': 'req-a1bcf757-51be-48ef-9635-9801062238ff'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.426258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3c43cec3c1b4a48a4814ae1dd938ffa', 'request_id': 'req-a1bcf757-51be-48ef-9635-9801062238ff'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.435831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3c43cec3c1b4a48a4814ae1dd938ffa', 'request_id': 'req-a1bcf757-51be-48ef-9635-9801062238ff'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.446033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:25.452727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] The token cache is being invalidate because project e3c43cec3c1b4a48a4814ae1dd938ffa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:08:25.453196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.459188 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a1bcf757-51be-48ef-9635-9801062238ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:08:25.461180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1110/2230] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:08:25 2022] DELETE /identity/v3/projects/e3c43cec3c1b4a48a4814ae1dd938ffa => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:08:25.466771 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.467081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.467283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.486989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:25.488236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:25.525119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:25.561785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1121/2231] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:25.569739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.570055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.570338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.592030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:25.593325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:25.605386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1111/2232] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:08:25.606591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.616683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66bff2-2199-403d-81d5-9e84c61116af None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.621964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.622742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.623081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.623370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.624085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:08:25.624416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.626071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.643195 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1122/2233] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:08:25.644479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.658344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb862b9-35cf-43c2-a8a4-76cd957c97b5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.665018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.665687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.665965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.666233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.666971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.668948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.699566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1112/2234] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:08:25 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:08:25.703819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.716135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b97a22-2794-459b-9fc3-a9ee92e88a68 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.773037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.773718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.773995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.774267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.774979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.776983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.805312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1123/2235] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:08:25 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:08:25.806421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.818035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5ca2-0de7-4256-88d5-aed2e3cd28ae admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.825136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.825907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.826246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.826582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.827417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.829418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.841717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1113/2236] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:08:25.845976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.856347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a153b-f3ca-4379-9c5c-76a8f9093343 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.861760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.862449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.862723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.863060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.863767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.865430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b07573-2ebf-4385-b747-fa50018a6596 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.875878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1124/2237] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:08:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:08:25.879771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:25.889975 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8673ccf-c66a-41f2-bc23-64fd6cefb34e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:25.895762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:25.896717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.896993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.897256 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] PATH_INFO: `/v3/projects/00e6c67a76dc44bfa013af76d6db5ee6/users/ebd6dd3728044282b9b5bd4bf1ffdf53/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.917871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00e6c67a76dc44bfa013af76d6db5ee6, user_id=ebd6dd3728044282b9b5bd4bf1ffdf53, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:25.920546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:25.937130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1114/2238] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:08:25 2022] PUT /identity/v3/projects/00e6c67a76dc44bfa013af76d6db5ee6/users/ebd6dd3728044282b9b5bd4bf1ffdf53/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:08:25.942840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ae-1a7b-4330-9aad-e20b2ed4b7cc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:25.943264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ae-1a7b-4330-9aad-e20b2ed4b7cc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:25.943418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db822ae-1a7b-4330-9aad-e20b2ed4b7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:25.964680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4db822ae-1a7b-4330-9aad-e20b2ed4b7cc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:25.965897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4db822ae-1a7b-4330-9aad-e20b2ed4b7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:26.028649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1125/2239] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:08:26.038863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:26.040721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:26.101663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c859d-740f-4289-afe2-2568a4dc7932 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:26.105273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:26.106002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:26.106275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:26.106544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:26.116186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:26.117709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:26.127751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1115/2240] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:30.518603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.519131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.519209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.557409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] MFA Rules not processed for user `ebd6dd3728044282b9b5bd4bf1ffdf53`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:30.557409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:30.590454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:30.628879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1126/2241] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:30.633331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:30.643126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cc1c-84b2-4e13-bd78-023309751ca8 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:30.647751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:30.648456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.648730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.648998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.649686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:30.651629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:30.679982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1116/2242] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:08:30 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:08:30.684252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:30.695401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebcda7-bb1e-490c-8bf8-1557a859bbb0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:30.781975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:30.782755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.783034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.783334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.784071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:30.786121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:30.811841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1127/2243] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:08:30 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:08:30.813096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:30.824023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6c01e-d1aa-459d-937e-64c033408ce5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:30.829874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:30.830788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.831068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.831347 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.832082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:30.834059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:30.847982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1117/2244] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:08:30.852308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:30.863044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae21875-c058-42e5-a4e5-d75c82b59861 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:30.867998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:30.868980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.869264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.869536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] PATH_INFO: `/v3/projects/62c2fa80a8664c49a73edf79886f94a8/users/847048cb84cf43338ddc5f4637c66280/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.889544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c2fa80a8664c49a73edf79886f94a8, user_id=847048cb84cf43338ddc5f4637c66280, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:30.892385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:30.907432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1128/2245] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:08:30 2022] PUT /identity/v3/projects/62c2fa80a8664c49a73edf79886f94a8/users/847048cb84cf43338ddc5f4637c66280/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:08:30.911265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:30.921974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba3826c-7768-4ee2-8548-8c8a8d3ff031 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:30.983060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:30.983680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:30.983961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:30.984293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:30.985040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:30.986714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006b7ba-5230-4f25-9138-64dee762cb84 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:31.000720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1118/2246] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:08:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:08:31.002102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:31.012708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a562949-3198-4d72-a612-2dd4c946bf69 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:31.017431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:31.018341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:31.018614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:31.018881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] PATH_INFO: `/v3/projects/62c2fa80a8664c49a73edf79886f94a8/users/847048cb84cf43338ddc5f4637c66280/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:31.020958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c2fa80a8664c49a73edf79886f94a8, user_id=847048cb84cf43338ddc5f4637c66280, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:31.023561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b10ab6-c26f-47b1-8321-ac88bbede08a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:31.038309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1129/2247] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:08:31 2022] PUT /identity/v3/projects/62c2fa80a8664c49a73edf79886f94a8/users/847048cb84cf43338ddc5f4637c66280/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:08:32.494018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:32.494589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:32.494788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:32.497031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1119/2248] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:08:32.507310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83de5c-db89-4930-a739-21ac0e24bac8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:32.507814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83de5c-db89-4930-a739-21ac0e24bac8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:32.508538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe83de5c-db89-4930-a739-21ac0e24bac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:32.566183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fe83de5c-db89-4930-a739-21ac0e24bac8 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:32.567436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fe83de5c-db89-4930-a739-21ac0e24bac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:32.655065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1130/2249] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:08:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:32.673155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:32.675091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:32.680775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:32.814602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8a21e-f64b-476a-ad57-a6aa0da073ac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:32.818834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:32.819713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:32.820005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:32.820334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:32.833567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:32.835752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062dbb99-74c3-4c52-beda-4349e5b052a2 service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:32.849294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1120/2250] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:32.966494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:32.966781 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:32.967113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:32.968652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1131/2251] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:08:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:08:32.974003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dcc5e-5176-46c3-a658-7841b1a2be06 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:32.974260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dcc5e-5176-46c3-a658-7841b1a2be06 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:32.974538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757dcc5e-5176-46c3-a658-7841b1a2be06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:33.000511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-757dcc5e-5176-46c3-a658-7841b1a2be06 None None] MFA Rules not processed for user `21ad18656f0a472783d122a1380d4905`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:33.003649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-757dcc5e-5176-46c3-a658-7841b1a2be06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:33.140757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1121/2252] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:08:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:33.153998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:33.155910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:33.169306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:33.181859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4422d2a-b631-4d5e-9689-33fc79305e92 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:33.189844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:33.190534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:33.190817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:33.191094 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:33.213701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:33.216291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c258ca-393e-454f-914e-effe81d621f2 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:33.241853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1132/2253] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:33.342682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca3f0-04b9-430f-9aae-72533d4fa04f None None] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:33.342986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca3f0-04b9-430f-9aae-72533d4fa04f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:33.343266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130ca3f0-04b9-430f-9aae-72533d4fa04f None None] PATH_INFO: `/` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:33.345312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1122/2254] 10.222.0.26 () {54 vars in 921 bytes} [Thu Jul 7 04:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 07 04:08:33.353916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406911-79df-41c4-88ee-4090bfe2db63 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:33.354227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406911-79df-41c4-88ee-4090bfe2db63 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:33.354572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406911-79df-41c4-88ee-4090bfe2db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:33.402102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3d406911-79df-41c4-88ee-4090bfe2db63 None None] MFA Rules not processed for user `2bd030577928438b940c477cb4fc2456`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:33.406991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3d406911-79df-41c4-88ee-4090bfe2db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:33.426726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1133/2255] 10.222.0.26 () {58 vars in 1018 bytes} [Thu Jul 7 04:08:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:33.441905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca3f0-04b9-430f-9aae-72533d4fa04f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:33.457075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130ca3f0-04b9-430f-9aae-72533d4fa04f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:33.462119 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:33.463314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:33.463811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:33.464343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:33.477714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:33.479489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b1623-bdfe-4875-9050-d7cf7239f268 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:33.505761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1123/2256] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:36.478653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:36.479194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:36.479194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:36.523223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] MFA Rules not processed for user `847048cb84cf43338ddc5f4637c66280`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:36.524494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:36.567164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:36.567976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:36.568286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:36.593122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:36.594395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:36.643699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1134/2257] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:36.658059 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:36.659407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:36.663544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1124/2258] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:08:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:36.677011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:36.679129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:36.683778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc088c-36f2-4359-afe7-693136d0128a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:36.692931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:36.693861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:36.694148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:36.694854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:36.714684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:36.768166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ebac35-b24b-4ef3-9d9c-ae723f5d2c1d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:36.772087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:36.773754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc2dc5-9a4e-41f7-b90a-ce7740ff4d2b service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:36.774200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:36.774863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:36.775140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:36.775411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:36.784963 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:36.785439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1135/2259] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:36.786677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:36.795587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1125/2260] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:08:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 07 04:08:38.268291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:38.269403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:38.269403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:38.292222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] MFA Rules not processed for user `ebd6dd3728044282b9b5bd4bf1ffdf53`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:08:38.294123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:38.301791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1136/2261] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:08:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:08:46.792021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=20 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:48.283129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=73 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:08:58.181175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:58.191346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4392eda-2f92-4956-bb99-61f5db029bcc service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:58.195665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:58.196332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:58.196608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:58.196862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:58.198943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:58.213966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:58.215442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de81c1a0-d7d8-4f71-bd59-7a9b2ab1ee36 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:58.226861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1126/2262] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:08:59.412690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:08:59.423603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3cda7-510e-4fda-90b1-3de9d786757f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:08:59.428048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:08:59.428727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:08:59.429005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:08:59.429276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:08:59.431442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:08:59.445739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:08:59.447184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:08:59.459435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1137/2263] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:08:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:09:04.195996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:04.196866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:04.197323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:04.220564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:09:04.221858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:04.231077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1127/2264] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:09:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:09:04.247110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:04.261809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e72cc-1612-4366-8f71-29fa422aa93b service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:04.267948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:04.269036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:04.270129 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:04.271283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:04.281447 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:04.283565 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:04.294774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1138/2265] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:09:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:09:14.211180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=9 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:14.290115 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=12 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:16.568773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:16.570559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:16.589600 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e575b6-ae53-4fb4-93d8-35af674623b9 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:16.596766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:16.597475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:16.597790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:16.598144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:16.600183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:16.669800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:16.671420 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:16.681376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1128/2266] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:09:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:09:19.789083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:19.799878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a79be-e16a-482f-b276-41adf835b836 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:19.804956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:19.805613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:19.805896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:19.806155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:19.816165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:19.817651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4651d-b86c-4f58-aff5-155ad89ca871 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:19.827509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1139/2267] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:09:19 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:09:26.676822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:29.657758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:29.667941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c55f0-e907-448e-a5db-4ad7d1ca4af1 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:29.672514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:29.673165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:29.673448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:29.673722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:29.675727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:29.685402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:29.686839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:29.695024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1129/2268] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:09:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:09:29.822914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:32.568642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:32.569288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:32.569288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:32.588299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] MFA Rules not processed for user `26ce1c1b87eb441bb883c639c92339d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:09:32.589473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:32.599391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1140/2269] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:09:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:09:38.907180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:38.923690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b9a11-f116-4c3c-a6ec-73d6ec245f64 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:38.930173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:38.930861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:38.931139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:38.931410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:38.933419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:38.946719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:38.948344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:38.959777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1130/2270] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:09:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:09:42.583114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:45.245130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:09:45.258585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0b2d3-f3ad-4023-9ac8-61f6ef69573e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:09:45.264737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:09:45.265378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:09:45.265655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:09:45.265908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:09:45.267896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:09:45.328039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:09:45.329697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376aea6a-ad3a-4b5d-8a1f-0271d762491f service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:09:45.339832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1141/2271] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:09:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:09:48.955087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=12 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:09:55.334751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=28 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:18.143220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:10:18.155062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0785f78c-489b-4f7e-97b6-211333144a14 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:10:18.161259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:10:18.161897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:18.162170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:18.162440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:18.164387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:18.227822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:10:18.230127 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:10:18.240153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1131/2272] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:10:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:10:28.235435 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=28 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:33.108935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:33.109425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:33.109823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:33.127658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] MFA Rules not processed for user `82a27d0525d942d99b3c5b19971208dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:10:33.128873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:33.136827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1142/2273] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:10:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:10:33.468952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:10:33.479893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460f15d-450f-451f-be54-f958dabbe987 service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:10:33.484379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:10:33.485058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:33.485338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:33.485609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:33.487741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:33.498743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:10:33.500192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:10:33.508217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1132/2274] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:10:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:10:33.838317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:10:33.839910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:33.910772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d15044-efd9-472b-b476-ec270e0f1833 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:10:33.915956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:10:33.916632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:33.916907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:33.917169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:33.919078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:33.931257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:10:33.932902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:10:33.943173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1143/2275] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:10:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:10:35.712436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:10:35.726035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3263fb-f228-4d17-b7a3-59aae5fcdd64 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:10:35.731718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:10:35.732388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:35.732663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:35.732928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:35.734771 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:35.796569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:10:35.799534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18934230-ad46-443c-bfc5-53601ef61740 service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:10:35.813022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1133/2276] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:10:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:10:43.938924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=35 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:45.808312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=34 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:45.958602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:10:45.972446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79128d0d-3518-4cf7-8946-24d8a706afc4 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:10:45.993416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:10:45.994306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:45.994574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:45.995222 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:46.001504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:46.015260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:10:46.017260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:10:46.029809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1144/2277] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:10:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:10:46.497185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:10:46.497424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:10:46.497701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:10:46.515092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] MFA Rules not processed for user `ca817816906a46a9a2423dc427fa3cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:10:46.516415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:10:46.523728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1134/2278] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:10:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:10:56.024568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:10:56.510421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:05.727442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:05.739778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49051f83-62a4-4ccc-a094-04fcd11f28cd service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:05.746621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:05.747617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:05.748109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:05.748637 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:05.750753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:05.765406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:05.767014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a85b9-bfcd-4446-8f08-3bd3489f328c service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:05.778642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1145/2279] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:15.773606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:16.968404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:16.978733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a89eeb-10d9-4629-9005-278438863d3d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:16.982705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:16.984089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:16.984413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:16.984694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:16.986646 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:17.055474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:17.057014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:17.067224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1135/2280] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:19.685738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:19.686191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:19.686280 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:19.706283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] MFA Rules not processed for user `029553978cc8405294ccb302665edbe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:19.707760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:19.722945 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1146/2281] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:20.386717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:20.401338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1c2f0-b83b-4b38-96c3-246c04767131 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:20.408163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:20.409057 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:20.409500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:20.409916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:20.412054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:20.424504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:20.426235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:20.449200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1136/2282] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:20.466825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:20.469237 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:20.488359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abb66-dd18-4056-ab1c-2a5c6a616351 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:20.498140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:20.499302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:20.500254 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:20.501112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] PATH_INFO: `/v3/users/26ce1c1b87eb441bb883c639c92339d5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:20.503374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ce1c1b87eb441bb883c639c92339d5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:20.505456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:20.566306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ce1c1b87eb441bb883c639c92339d5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.574362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ce1c1b87eb441bb883c639c92339d5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.588761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ce1c1b87eb441bb883c639c92339d5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.589422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ce1c1b87eb441bb883c639c92339d5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.590193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42b41016-e26b-488e-a323-4fc1f375b6a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ce1c1b87eb441bb883c639c92339d5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.602826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1147/2283] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:20 2022] DELETE /identity/v3/users/26ce1c1b87eb441bb883c639c92339d5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:20.820091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:20.837292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c9370-ce1f-46ad-976b-7c809f6d3886 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:20.904079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:20.904595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:20.904869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:20.905136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] PATH_INFO: `/v3/projects/dbc19ceca20143fe9b2989336a7c755e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:20.906334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbc19ceca20143fe9b2989336a7c755e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:20.908300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:20.963959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbc19ceca20143fe9b2989336a7c755e', 'request_id': 'req-5a662ab2-bdbe-4459-b951-5a17490c2f42'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.972924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbc19ceca20143fe9b2989336a7c755e', 'request_id': 'req-5a662ab2-bdbe-4459-b951-5a17490c2f42'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.979120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbc19ceca20143fe9b2989336a7c755e', 'request_id': 'req-5a662ab2-bdbe-4459-b951-5a17490c2f42'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.990845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] The token cache is being invalidate because project dbc19ceca20143fe9b2989336a7c755e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:20.991135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.991772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5a662ab2-bdbe-4459-b951-5a17490c2f42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:20.993388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1137/2284] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:20 2022] DELETE /identity/v3/projects/dbc19ceca20143fe9b2989336a7c755e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:20.998328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:20.998798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:20.998934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.018049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:21.019330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:21.078849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1148/2285] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:21.087499 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.087900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.088351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.107641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:21.108792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:21.116855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1138/2286] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:21.121005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.131705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bde6b9c-00d0-4690-a8e8-4b407a67fccd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.137383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.138055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.138365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.138654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.139451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:21.139780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.141412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.158987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1149/2287] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:11:21.160439 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.170461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4ed1-27c8-4e80-b62c-188ab341e19a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.177749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:21.180247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.182002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.182317 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.182691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.183524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.185666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.232751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1139/2288] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:21 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:21.236868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.246904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59d08c-439f-435a-9e09-90f9a2f70c96 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.298170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:21.309399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.310423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.310812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.311091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.312167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.314403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.336888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1150/2289] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:21 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:21.341045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.351843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f8d07-4745-4d4c-9f7e-58373b244647 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.356484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.357164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.357437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.357784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.358474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.360207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.371310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1140/2290] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:21.375783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.386938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0888c7a-164b-4a93-bc68-3dfeaf940a70 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.391853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.392556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.392831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.393099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.393827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.395431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68749989-5cbb-43e6-a13d-56ed7d721fc1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.406007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1151/2291] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:21.410314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.423930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f25bd-b9cf-4760-9108-efe283cf6409 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.429069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.429969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.430245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.430485 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] PATH_INFO: `/v3/projects/507bde16dbc642b0bd28b159e2b29122/users/40b037c231b548c29393638b25dacfbf/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.446617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=507bde16dbc642b0bd28b159e2b29122, user_id=40b037c231b548c29393638b25dacfbf, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.449323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.469139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1141/2292] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:21 2022] PUT /identity/v3/projects/507bde16dbc642b0bd28b159e2b29122/users/40b037c231b548c29393638b25dacfbf/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:21.479742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.480032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.480361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.506812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] MFA Rules not processed for user `40b037c231b548c29393638b25dacfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:21.508034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:21.582174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1152/2293] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:21.594083 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:21.596050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:21.680957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2d77e8-4ad8-4126-98bc-c02e217c68a6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:21.685087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:21.685743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:21.686141 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:21.686409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:21.695761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:21.697293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42625ccf-4b5c-4649-8590-696a8c8b413e service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:21.708180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1142/2294] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:30.200748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:30.281253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f57c5-0b93-4635-890a-2ebfc423da4a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:30.285845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:30.286759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:30.287039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:30.287309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] PATH_INFO: `/v3/users/40b037c231b548c29393638b25dacfbf` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:30.288525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b037c231b548c29393638b25dacfbf)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:30.290474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:30.339112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b037c231b548c29393638b25dacfbf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.347035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b037c231b548c29393638b25dacfbf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.355328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:30.364476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b037c231b548c29393638b25dacfbf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.365391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b037c231b548c29393638b25dacfbf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.366370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b037c231b548c29393638b25dacfbf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.381203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1153/2295] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:30 2022] DELETE /identity/v3/users/40b037c231b548c29393638b25dacfbf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:30.386174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:30.386636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:30.386730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:30.407007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:30.408293 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:30.471551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1143/2296] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:30.481935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:30.483449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:30.543198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825677b9-14f1-408b-8479-5cab4767a5bf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:30.547269 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:30.547961 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:30.548283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:30.548560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:30.558150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:30.559600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cff2f6-82d5-4dee-abec-bcd847f42ca3 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:30.569290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1154/2297] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:30.860803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:30.862513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:30.874762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bbbce0-255e-45a6-a837-20132b5fa5cc None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:30.879657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:30.880552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:30.880805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:30.881070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] PATH_INFO: `/v3/projects/507bde16dbc642b0bd28b159e2b29122` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:30.882262 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=507bde16dbc642b0bd28b159e2b29122)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:30.884220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:30.901965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:30.933839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '507bde16dbc642b0bd28b159e2b29122', 'request_id': 'req-3ab33163-40eb-4b1e-91b1-8195ea8663f5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.942118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '507bde16dbc642b0bd28b159e2b29122', 'request_id': 'req-3ab33163-40eb-4b1e-91b1-8195ea8663f5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.950851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '507bde16dbc642b0bd28b159e2b29122', 'request_id': 'req-3ab33163-40eb-4b1e-91b1-8195ea8663f5'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.964556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] The token cache is being invalidate because project 507bde16dbc642b0bd28b159e2b29122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:30.964842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.965536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ab33163-40eb-4b1e-91b1-8195ea8663f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:30.967161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1144/2298] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:30 2022] DELETE /identity/v3/projects/507bde16dbc642b0bd28b159e2b29122 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:30.972160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:30.972448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:30.972730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:30.992023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:30.993262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:31.051255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1155/2299] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:31.059007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.059291 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.059559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.078931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:31.080147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:31.089711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1145/2300] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:31.094117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.104826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b390766-b7a8-4971-83c8-9b4e15f068a5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.110266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.110915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.111192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.111449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.112151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:31.112486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.114194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.125509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1156/2301] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:11:31.129796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.139258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e082b-effb-40f8-a884-e60150d741b6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.144453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.145172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.145447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.145711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.146404 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.148314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.175300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1146/2302] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:31.179578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.191302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c928e-33d0-4454-a41b-23ddd832fa3f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.254514 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.255242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.255587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.255868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.256620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.258561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.275283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:31.281423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1157/2303] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:31.285977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.296604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b590b8-ef31-4edd-b3a2-0f01106266c3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.301505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.302207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.302489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.302761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.303495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.305222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.316961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1147/2304] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:31.321179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.331861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d7965-45e5-4320-a8d1-00a62ea35b90 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.336801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.337561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.337914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.338241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.339045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.340763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac7ca7d-1508-4d90-b771-879d55489608 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.351618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1158/2305] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:31.356062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.366716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487815c1-4757-4397-8fca-e061d812a298 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.372473 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.373398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.373669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.373933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] PATH_INFO: `/v3/projects/b5cf36813dda450e94d8c55714ab05ba/users/40592cc41c6c4672b063f41e07eba6b1/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.389155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5cf36813dda450e94d8c55714ab05ba, user_id=40592cc41c6c4672b063f41e07eba6b1, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.391841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.406186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1148/2306] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:31 2022] PUT /identity/v3/projects/b5cf36813dda450e94d8c55714ab05ba/users/40592cc41c6c4672b063f41e07eba6b1/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:31.417803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.418093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.418372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.445207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] MFA Rules not processed for user `40592cc41c6c4672b063f41e07eba6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:31.446423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:31.510849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1159/2307] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:31.515366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.586237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217f5c4-e2b5-4867-bb22-40d4ea9d89a0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.591005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.591663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.591932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.592232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.592915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.594822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.625777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1149/2308] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:31.630004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.641502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28276ad7-2591-430d-83e0-a221707aaacb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.707806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.708520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.708791 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.709040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.709752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.711685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.732694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1160/2309] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:31.736785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.747568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e58c7-d089-4fae-b612-c7d8ded88e20 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.753229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.753929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.754238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.754532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.755413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.757993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.771143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1150/2310] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:31.776178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.792248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f2b2d-4901-46d5-ba2c-feb2f912cf5b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.800684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.801905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.802176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.802463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] PATH_INFO: `/v3/projects/e847e7404f7d413f8176db790c41235c/users/6b3591f0e7d642bba1657e5dbcee37d1/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.818291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847e7404f7d413f8176db790c41235c, user_id=6b3591f0e7d642bba1657e5dbcee37d1, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.821410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.836203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1161/2311] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:31 2022] PUT /identity/v3/projects/e847e7404f7d413f8176db790c41235c/users/6b3591f0e7d642bba1657e5dbcee37d1/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:31.840310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.851471 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b9462-081a-4ebd-8c70-eef5caa0c074 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.865374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:31.915012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.915720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.916001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.916275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.917038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.918645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307a858-4247-437c-969f-5ae6a94cd553 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.929085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1151/2312] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:31.933276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:31.944950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2dec36-cb9e-4b95-89bb-1959c46f8dcd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:31.950072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:31.950957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.951227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.951493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] PATH_INFO: `/v3/projects/e847e7404f7d413f8176db790c41235c/users/6b3591f0e7d642bba1657e5dbcee37d1/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:31.953510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847e7404f7d413f8176db790c41235c, user_id=6b3591f0e7d642bba1657e5dbcee37d1, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:31.956151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:31.967202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1162/2313] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:31 2022] PUT /identity/v3/projects/e847e7404f7d413f8176db790c41235c/users/6b3591f0e7d642bba1657e5dbcee37d1/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:31.977657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:31.977937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:31.978209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:32.005859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] MFA Rules not processed for user `6b3591f0e7d642bba1657e5dbcee37d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:32.007051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:32.082578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1152/2314] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:32.094700 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:32.096779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:32.130321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:32.156824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b639ecb-8ee5-426c-bd8b-fc1df4470d14 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:32.161138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:32.161780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:32.162054 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:32.162319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:32.172708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:32.174228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:32.184453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1163/2315] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:32.259898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:32.269770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d29f9b-cab2-4fcb-ae30-28cdc508c49e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:32.273807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:32.274484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:32.274760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:32.275024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:32.334007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:32.335348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9da08-dc7a-4b40-be6a-7f4ab0c55e88 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:32.344611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1153/2316] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:39.486792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:39.554285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6085-e389-4799-af2c-1efb5c66eab6 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:39.562538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:39.563788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:39.564085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:39.564484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] PATH_INFO: `/v3/users/40592cc41c6c4672b063f41e07eba6b1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:39.566279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40592cc41c6c4672b063f41e07eba6b1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:39.568528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:39.618399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40592cc41c6c4672b063f41e07eba6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:39.627428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40592cc41c6c4672b063f41e07eba6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:39.641308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40592cc41c6c4672b063f41e07eba6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:39.642078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40592cc41c6c4672b063f41e07eba6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:39.642701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40592cc41c6c4672b063f41e07eba6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:39.661960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1164/2317] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:39 2022] DELETE /identity/v3/users/40592cc41c6c4672b063f41e07eba6b1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:39.670455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:39.670950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:39.671044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:39.694766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:39.696010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:39.730597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:39.762405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1154/2318] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:39.772412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:39.773972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:39.834773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37026cd-08db-4c08-b5c2-a58d48517851 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:39.839080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:39.839731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:39.840010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:39.840325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:39.847873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:39.850452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:39.852582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:39.864306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1165/2319] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:40.143544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:40.145164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:40.159521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f7cf1-9217-4ebb-828c-fe14d132a192 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:40.164392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:40.166308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.166588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.166857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] PATH_INFO: `/v3/projects/b5cf36813dda450e94d8c55714ab05ba` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.168076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5cf36813dda450e94d8c55714ab05ba)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:40.170153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:40.219448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5cf36813dda450e94d8c55714ab05ba', 'request_id': 'req-f40079bd-b14f-4270-820e-e3adab806640'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.227762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5cf36813dda450e94d8c55714ab05ba', 'request_id': 'req-f40079bd-b14f-4270-820e-e3adab806640'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.233507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5cf36813dda450e94d8c55714ab05ba', 'request_id': 'req-f40079bd-b14f-4270-820e-e3adab806640'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.244870 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] The token cache is being invalidate because project b5cf36813dda450e94d8c55714ab05ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:40.245158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.245874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.247506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1155/2320] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:40 2022] DELETE /identity/v3/projects/b5cf36813dda450e94d8c55714ab05ba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:40.251597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:40.261698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59068f-0735-41cf-a453-f70e30a0be65 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:40.320675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:40.321548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.321822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.322090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] PATH_INFO: `/v3/users/6b3591f0e7d642bba1657e5dbcee37d1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.323441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b3591f0e7d642bba1657e5dbcee37d1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:40.325743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:40.371544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b3591f0e7d642bba1657e5dbcee37d1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.379279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b3591f0e7d642bba1657e5dbcee37d1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.391642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b3591f0e7d642bba1657e5dbcee37d1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.392294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b3591f0e7d642bba1657e5dbcee37d1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.392886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c1369ed-be23-4260-8011-e9bc3479266f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b3591f0e7d642bba1657e5dbcee37d1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.405134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1166/2321] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:40 2022] DELETE /identity/v3/users/6b3591f0e7d642bba1657e5dbcee37d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:40.674814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:40.676432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:40.694311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40079bd-b14f-4270-820e-e3adab806640 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:40.753727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:40.754821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.755105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.755379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] PATH_INFO: `/v3/projects/e847e7404f7d413f8176db790c41235c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.756704 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e847e7404f7d413f8176db790c41235c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:40.758648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:40.806126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e847e7404f7d413f8176db790c41235c', 'request_id': 'req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.814416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e847e7404f7d413f8176db790c41235c', 'request_id': 'req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.818603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:40.821149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e847e7404f7d413f8176db790c41235c', 'request_id': 'req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.834239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] The token cache is being invalidate because project e847e7404f7d413f8176db790c41235c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:40.834540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.835241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-65b6b8f5-2140-47d0-af6f-60a9e86dd59f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:40.836928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1156/2322] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:40 2022] DELETE /identity/v3/projects/e847e7404f7d413f8176db790c41235c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:40.842035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.842501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.842614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.862147 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:40.863335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:40.936765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1167/2323] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:40.944571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.944851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.945095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.964939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:40.966178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:40.975259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1157/2324] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:40.979793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:40.989852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a8439-88aa-4ede-a154-6f8df367ee93 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:40.995230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:40.995881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:40.996157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:40.996455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:40.997174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:40.997476 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:40.999074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.010749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1168/2325] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:11:41.015122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.025044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84814578-42f5-4897-8f9d-637ee2c54635 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.030913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.031560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.031838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.032108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.032860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.034760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.063273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1158/2326] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:41.067511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.072833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:41.079652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f1d79d-d66f-42e2-8f8c-bdf19a9deb50 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.139778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.140468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.140745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.141016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.141741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.143625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.166016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1169/2327] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:41.170150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.180539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970db90-b172-4e98-9b5d-bc1a8fb90ec0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.185630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.186284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.186568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.186900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.187575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.189207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.200371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1159/2328] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:41.204301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.214642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c238f-e9fd-43bc-be5f-611b2786d7d2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.219489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.220172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.220451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.220719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.221443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.223093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f99222-7f6e-4dbc-beae-693694547005 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.233247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1170/2329] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:41.237213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.247249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e217554-c1c5-4f81-a123-2df62702f95b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.252896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.253775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.254048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.254362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] PATH_INFO: `/v3/projects/d95d8c4117e14221b0a3597da54fa240/users/881e94f1eb4144449385571ba75c4127/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.270220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95d8c4117e14221b0a3597da54fa240, user_id=881e94f1eb4144449385571ba75c4127, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.272930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.288001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1160/2330] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:41 2022] PUT /identity/v3/projects/d95d8c4117e14221b0a3597da54fa240/users/881e94f1eb4144449385571ba75c4127/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:11:41.299344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.299631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.299899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.328006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] MFA Rules not processed for user `881e94f1eb4144449385571ba75c4127`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:41.329277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:41.406191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1171/2331] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:41.410860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.474300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7016a3-11a4-4776-b91a-e3b07632221b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.479425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.480079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.480399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.480660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.481346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.483237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.511082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1161/2332] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:41.515209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.526190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8b61a1-baf4-46ba-b843-1d2aa4346200 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.584160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.584850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.585119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.585413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.586106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.588031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.604588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:41.611215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1172/2333] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:41.615781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.626264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79292a-91ba-43c2-9c6e-8ebcdf50cb68 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.631210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.631862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.632163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.632434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.633199 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.634777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.645315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1162/2334] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:41.649693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.660232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb5fdd-a4aa-40c3-ae6b-ec1268de9729 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.666330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.667589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.667846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.668163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] PATH_INFO: `/v3/projects/2d70932a7d044e0c8eac72dcefabcd69/users/8f7b199e9d57453eaf72f08314fb005a/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.684828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d70932a7d044e0c8eac72dcefabcd69, user_id=8f7b199e9d57453eaf72f08314fb005a, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.687524 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.703211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1173/2335] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:41 2022] PUT /identity/v3/projects/2d70932a7d044e0c8eac72dcefabcd69/users/8f7b199e9d57453eaf72f08314fb005a/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:41.707233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.717558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d62591-5683-4f0b-9c69-52ba4707d718 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.775243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.775909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.776218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.776476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.777220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.778894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d199c4-6de2-42d1-a10f-17833ebb8b2d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.780334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:41.790674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1163/2336] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:41.794910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.805397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9558589-de5e-48b7-a511-d9b16c397e7f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:41.811291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:41.812221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.812497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.812772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] PATH_INFO: `/v3/projects/2d70932a7d044e0c8eac72dcefabcd69/users/8f7b199e9d57453eaf72f08314fb005a/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.815027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d70932a7d044e0c8eac72dcefabcd69, user_id=8f7b199e9d57453eaf72f08314fb005a, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:41.817826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:41.829760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1174/2337] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:41 2022] PUT /identity/v3/projects/2d70932a7d044e0c8eac72dcefabcd69/users/8f7b199e9d57453eaf72f08314fb005a/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:41.839940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:41.840259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:41.840542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:41.868318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] MFA Rules not processed for user `8f7b199e9d57453eaf72f08314fb005a`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:41.869506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:41.946171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1164/2338] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:41.957988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:41.959920 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:42.021120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760ed48-5632-45f5-8889-ad41b47d4920 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:42.026759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:42.027346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.027593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.028035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.041923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:42.043369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec16115-27c4-4d5a-b438-27dc6990c98a service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:42.054040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1175/2339] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:42.122719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:42.197745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef542-7870-4dea-8d54-2415f1dae6d3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:42.203348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:42.204259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.204539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.204810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] PATH_INFO: `/v3/users/881e94f1eb4144449385571ba75c4127` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.206139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] RBAC: Authorizing `identity:delete_user(user_id=881e94f1eb4144449385571ba75c4127)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:42.208147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:42.268773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881e94f1eb4144449385571ba75c4127'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.277458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881e94f1eb4144449385571ba75c4127'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.278007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881e94f1eb4144449385571ba75c4127'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.278602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881e94f1eb4144449385571ba75c4127'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.290594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881e94f1eb4144449385571ba75c4127'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.298675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:42.303411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1165/2340] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:42 2022] DELETE /identity/v3/users/881e94f1eb4144449385571ba75c4127 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:42.308345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.308633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.308932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.326821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:42.328021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:42.390761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1176/2341] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:42.400758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:42.402283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:42.463103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3611-c99d-40e3-8d89-8961bdd8aafa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:42.467474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:42.468157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.468441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.468726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.478387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:42.479822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:42.489478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1166/2342] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:42.759711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:42.761344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:42.773487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780eaa0-c661-49ed-a500-2f5ea9443d20 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:42.779523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:42.780674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.781116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.781425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] PATH_INFO: `/v3/projects/d95d8c4117e14221b0a3597da54fa240` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.782912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95d8c4117e14221b0a3597da54fa240)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:42.785045 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:42.835422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95d8c4117e14221b0a3597da54fa240', 'request_id': 'req-e521ebc0-ae69-4716-b7a4-53687d0f931c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.841822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95d8c4117e14221b0a3597da54fa240', 'request_id': 'req-e521ebc0-ae69-4716-b7a4-53687d0f931c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.849265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95d8c4117e14221b0a3597da54fa240', 'request_id': 'req-e521ebc0-ae69-4716-b7a4-53687d0f931c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.850548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:42.861810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] The token cache is being invalidate because project d95d8c4117e14221b0a3597da54fa240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:42.862115 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.862723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:42.864431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1177/2343] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:42 2022] DELETE /identity/v3/projects/d95d8c4117e14221b0a3597da54fa240 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:42.868525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:42.880583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667564d-144c-4679-b93a-c3936a942caa service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:42.938841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:42.939764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:42.940043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:42.940925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] PATH_INFO: `/v3/users/8f7b199e9d57453eaf72f08314fb005a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:42.941632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7b199e9d57453eaf72f08314fb005a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:42.943603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:42.992764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7b199e9d57453eaf72f08314fb005a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.000986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7b199e9d57453eaf72f08314fb005a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.001589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7b199e9d57453eaf72f08314fb005a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.002252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7b199e9d57453eaf72f08314fb005a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.013814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-35e24492-e49a-4cce-ab8f-6a71bd087241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7b199e9d57453eaf72f08314fb005a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.025859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1167/2344] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:42 2022] DELETE /identity/v3/users/8f7b199e9d57453eaf72f08314fb005a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:43.305666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.307106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:43.320315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ebc0-ae69-4716-b7a4-53687d0f931c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.378496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.379375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.379650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.379926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] PATH_INFO: `/v3/projects/2d70932a7d044e0c8eac72dcefabcd69` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.381170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d70932a7d044e0c8eac72dcefabcd69)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.383074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.438644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d70932a7d044e0c8eac72dcefabcd69', 'request_id': 'req-7a49728d-fa82-48a7-bcff-316bf87889d7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.445486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d70932a7d044e0c8eac72dcefabcd69', 'request_id': 'req-7a49728d-fa82-48a7-bcff-316bf87889d7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.454778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d70932a7d044e0c8eac72dcefabcd69', 'request_id': 'req-7a49728d-fa82-48a7-bcff-316bf87889d7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.465562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] The token cache is being invalidate because project 2d70932a7d044e0c8eac72dcefabcd69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:43.465867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.466511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7a49728d-fa82-48a7-bcff-316bf87889d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:43.468085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1178/2345] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:43 2022] DELETE /identity/v3/projects/2d70932a7d044e0c8eac72dcefabcd69 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:43.473122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.473405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.473695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.492626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:43.493829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:43.511447 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:43.557295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1168/2346] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:43.570032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.570312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.570577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.590650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:43.591842 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:43.600424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1179/2347] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:43.605331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.618314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc7ffed-6080-4603-b486-b341c3cce637 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.623174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.623853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.624152 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.624433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.625163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:43.625464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.627058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.638945 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1169/2348] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:11:43.643236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.652722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559df3d6-1bd1-4228-a505-8e0d0f6428f5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.657331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.657979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.658250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.658539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.659209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.661198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.690375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1180/2349] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:43 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:43.695695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.706595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0caf225-306b-4a02-acd9-9c28597ac7bd admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.763741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.764437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.764716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.764989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.765681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.767587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.790694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1170/2350] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:43 2022] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:43.796291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.806949 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dae05-ab74-4b6a-9384-64ae017e5efa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.812457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.813121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.813394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.813657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.814382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.815987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.826994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1181/2351] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:43.830854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.841058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989dfe-1f05-49a5-b07c-6d995e0f005d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.846616 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.847294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.847542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.847808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.848776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.850363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74612c5e-2b4e-41d4-b592-1e1cfefc7af0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.860664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1171/2352] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:43.864705 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:43.876943 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4369916-39f5-496d-945a-0a603a2eed10 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:43.884620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:43.885856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.886181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.886481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] PATH_INFO: `/v3/projects/c2d9b72ea398480b975fe47bda3653d1/users/387b094c3c3d4119bfde07908fe3237e/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.903105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d9b72ea398480b975fe47bda3653d1, user_id=387b094c3c3d4119bfde07908fe3237e, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:43.905757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:43.921603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1182/2353] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:43 2022] PUT /identity/v3/projects/c2d9b72ea398480b975fe47bda3653d1/users/387b094c3c3d4119bfde07908fe3237e/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:43.932070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:43.932591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:43.932716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:43.960073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] MFA Rules not processed for user `387b094c3c3d4119bfde07908fe3237e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:43.961290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:44.028067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1172/2354] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:44.032828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.053715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:44.099303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268d9614-e1a0-41c0-80ac-d8ab9ac77ade admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.104453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.105098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.105366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.105644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.106332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.108257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.135796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1183/2355] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:44 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:44.140012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.151294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdd367-3991-4a14-aaea-95910628b51e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.163645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:44.207560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.208292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.208553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.208817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.209508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.211440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.230851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1173/2356] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:44 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:44.234990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.245620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c6bb0-8da6-43c4-84cb-082800a013b7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.250928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.251595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.251879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.252153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.252926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.254621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.265552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1184/2357] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:44.269877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.280391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ae309-41d0-4f8e-89f3-9a630d1a5559 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.285990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.286919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.287195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.287465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] PATH_INFO: `/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938/users/05e000d2cfe34a1ba3092047aeb95fc7/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.309325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c46ab41eab4d41b35b9c29ae3ed938, user_id=05e000d2cfe34a1ba3092047aeb95fc7, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.312014 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.328264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1174/2358] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:44 2022] PUT /identity/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938/users/05e000d2cfe34a1ba3092047aeb95fc7/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:44.332811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.343110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7aa5d-b5d7-4c5a-9c6d-8af7faca76fc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.402681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.403336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.403627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.403879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.404652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.406281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a4158-78ce-4725-a4bd-58b35b1977fd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.417360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1185/2359] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:44.422201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.434320 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf444e6d-a94c-4bdd-bc72-12e450aaceb0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.439391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.440433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.440715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.440986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] PATH_INFO: `/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938/users/05e000d2cfe34a1ba3092047aeb95fc7/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.442994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c46ab41eab4d41b35b9c29ae3ed938, user_id=05e000d2cfe34a1ba3092047aeb95fc7, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.445658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.456825 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1175/2360] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:44 2022] PUT /identity/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938/users/05e000d2cfe34a1ba3092047aeb95fc7/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:44.466882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.467175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.467451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.494910 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] MFA Rules not processed for user `05e000d2cfe34a1ba3092047aeb95fc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:44.496102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:44.579450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1186/2361] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:44.591266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.593462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:44.654285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541b73-2391-4b8d-9587-c2f23637385e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.658020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.658828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.658939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.659213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.672815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.674755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.686718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1176/2362] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:44.735631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:44.737073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:44.749720 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5dade-fe3d-4b84-9322-3fd8841d2c04 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:44.753416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:44.754079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:44.754501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:44.754780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:44.763702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:44.816064 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:44.817623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168edae6-b441-42e2-92a1-e536f1e80707 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:44.827298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1187/2363] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:48.136814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:48.208144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cc965-adcb-4d0e-a04f-ef3fb1fd598a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:48.212908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:48.213784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:48.214058 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:48.214328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] PATH_INFO: `/v3/users/387b094c3c3d4119bfde07908fe3237e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:48.215571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=387b094c3c3d4119bfde07908fe3237e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:48.217535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:48.232564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:48.266482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387b094c3c3d4119bfde07908fe3237e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.277135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387b094c3c3d4119bfde07908fe3237e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.277788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387b094c3c3d4119bfde07908fe3237e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.278432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387b094c3c3d4119bfde07908fe3237e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.290086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387b094c3c3d4119bfde07908fe3237e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.302463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1177/2364] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:48 2022] DELETE /identity/v3/users/387b094c3c3d4119bfde07908fe3237e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:48.307037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:48.307518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:48.307630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:48.326724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:48.327911 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:48.396402 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1188/2365] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:48.407573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:48.409345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:48.470217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1913ee-2dc7-40ff-ab89-289db67b6467 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:48.474180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:48.474827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:48.475103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:48.475375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:48.484432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:48.485847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:48.495149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1178/2366] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:48.778289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:48.779957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:48.792979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00228bc5-8593-4700-9651-310bb21883f1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:48.797798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:48.798674 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:48.798947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:48.799230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] PATH_INFO: `/v3/projects/c2d9b72ea398480b975fe47bda3653d1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:48.800522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d9b72ea398480b975fe47bda3653d1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:48.802568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:48.849047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d9b72ea398480b975fe47bda3653d1', 'request_id': 'req-f0423954-377d-4b71-8d5f-21fa96e89755'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.855037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d9b72ea398480b975fe47bda3653d1', 'request_id': 'req-f0423954-377d-4b71-8d5f-21fa96e89755'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.864550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d9b72ea398480b975fe47bda3653d1', 'request_id': 'req-f0423954-377d-4b71-8d5f-21fa96e89755'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.875065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] The token cache is being invalidate because project c2d9b72ea398480b975fe47bda3653d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:48.875375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.875995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:48.877570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1189/2367] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:48 2022] DELETE /identity/v3/projects/c2d9b72ea398480b975fe47bda3653d1 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:48.881768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:48.891876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ff7f3-a947-425c-82ae-fdbf739892ed service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:48.951632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:48.952550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:48.952824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:48.953094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] PATH_INFO: `/v3/users/05e000d2cfe34a1ba3092047aeb95fc7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:48.954289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e000d2cfe34a1ba3092047aeb95fc7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:48.956261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:48.995713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:49.004964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e000d2cfe34a1ba3092047aeb95fc7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.012645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e000d2cfe34a1ba3092047aeb95fc7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.013249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e000d2cfe34a1ba3092047aeb95fc7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.013941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e000d2cfe34a1ba3092047aeb95fc7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.025636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-55e6bad4-c6eb-4608-9a76-481ce2bae1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e000d2cfe34a1ba3092047aeb95fc7'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.038201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1179/2368] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:48 2022] DELETE /identity/v3/users/05e000d2cfe34a1ba3092047aeb95fc7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:49.346289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.347856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:49.363376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0423954-377d-4b71-8d5f-21fa96e89755 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.397388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:49.428096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.429057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.429335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.429608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] PATH_INFO: `/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.430916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c46ab41eab4d41b35b9c29ae3ed938)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.432914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.484564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c46ab41eab4d41b35b9c29ae3ed938', 'request_id': 'req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.491242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c46ab41eab4d41b35b9c29ae3ed938', 'request_id': 'req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.501388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c46ab41eab4d41b35b9c29ae3ed938', 'request_id': 'req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.515446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] The token cache is being invalidate because project d3c46ab41eab4d41b35b9c29ae3ed938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:49.515633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.516456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1c7e940e-efbb-4b34-9e22-ce5a7a379c53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:49.518241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1190/2369] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:49 2022] DELETE /identity/v3/projects/d3c46ab41eab4d41b35b9c29ae3ed938 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:49.524360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.524849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.524962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.544683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:49.545909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:49.612399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1180/2370] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:49.622760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.623032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.623318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.645031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:49.646233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:49.655160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1191/2371] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:49.659754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.669840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc29b45-3680-49d6-9990-d9871dc7f6f8 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.675133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.675806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.676087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.676394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.677145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:49.677451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.679091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.691494 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1181/2372] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:11:49.696028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.706224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d46b0-1a50-4870-b28a-347f440044d8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.711813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.712500 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.712808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.713074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.713772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.715698 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.747473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1192/2373] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:49 2022] POST /identity/v3/projects => generated 401 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:49.752013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.762876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6075f60-f6d0-4aa2-ade9-530de8dc75a1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.824433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.825498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.825776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.826048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.826746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.828721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.850463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1182/2374] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:49 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:49.856624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.867554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2440f-22cc-4754-9961-656a99d9e4ec admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.872651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.873323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.873601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.873872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.874609 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.876260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.887281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1193/2375] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:49.891414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.903061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3b949-eff4-4ae1-9942-fbe47254db48 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.909125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.909801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.910089 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.910359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.911243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.912901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca247da6-7c4b-47b9-9137-ee8b564cff94 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.924143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1183/2376] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:49.931594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:49.945401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5c9e21-572e-4d13-a8fc-1631cd14cb95 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:49.954726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:49.956228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:49.956687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:49.957131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] PATH_INFO: `/v3/projects/68bf1cfd304c4f91a2f35415a73bd140/users/94919f54214f4a8aa3398fb429317c2e/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:49.973331 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bf1cfd304c4f91a2f35415a73bd140, user_id=94919f54214f4a8aa3398fb429317c2e, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:49.975986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:49.991672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1194/2377] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:49 2022] PUT /identity/v3/projects/68bf1cfd304c4f91a2f35415a73bd140/users/94919f54214f4a8aa3398fb429317c2e/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:50.002608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.002926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.003255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.030231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] MFA Rules not processed for user `94919f54214f4a8aa3398fb429317c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:50.031463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:50.040324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:50.101757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1184/2378] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:50.106537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.172361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe60029-dd9a-4bc0-9168-842631405860 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.177888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.178550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.178827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.179099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.179784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.181762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.185297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:50.213865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1195/2379] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:50 2022] POST /identity/v3/projects => generated 401 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:50.218109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.230481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb52ef-b8d1-429c-a0e8-63514a09e5f2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.290597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.291324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.291626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.291901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.292711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.294829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.318171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1185/2380] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:50 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:50.323804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.334890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e755cfc-41b7-4247-873c-e3c2271732d1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.340614 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.341274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.341550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.341817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.342559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.344162 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.354795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1196/2381] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:50.358847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.369226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2030b18c-8a16-4609-8078-af40f653865e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.374410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.375309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.375585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.375858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] PATH_INFO: `/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4/users/986f914790624e48bbd5898f9603f0a0/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.391211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3ece0232974c49bb2f5b2c7b2a4bb4, user_id=986f914790624e48bbd5898f9603f0a0, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.394071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.408506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1186/2382] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:50 2022] PUT /identity/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4/users/986f914790624e48bbd5898f9603f0a0/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:50.412472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.422952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc5952-a46b-4cc2-a34a-cd1c175a4fe9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.483152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.483828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.484106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.484415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.485148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.486793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60a859-0755-47bb-85f7-6c66538ccc43 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.498153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1197/2383] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:11:50.503261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.524394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad817146-b702-4e85-9d82-7c93d7ae853b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.534064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.535440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.535790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.536060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] PATH_INFO: `/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4/users/986f914790624e48bbd5898f9603f0a0/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.538376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3ece0232974c49bb2f5b2c7b2a4bb4, user_id=986f914790624e48bbd5898f9603f0a0, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.541072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.553402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1187/2384] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:50 2022] PUT /identity/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4/users/986f914790624e48bbd5898f9603f0a0/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:50.565035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.565321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.565595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.592695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] MFA Rules not processed for user `986f914790624e48bbd5898f9603f0a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:50.593845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:50.664919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1198/2385] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:50 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:50.676301 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.678363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:50.737490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4533f-6061-4942-8f3b-066e232ad577 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.741456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.742093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.742366 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.742732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.752220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.753718 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.763185 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1188/2386] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:50.836146 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:50.846276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae6437d-5cdf-43df-9849-f91450865603 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:50.850641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:50.851310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:50.851584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:50.851850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:50.906486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:50.910974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:50.912969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf99abd-9afb-40cd-b9e0-2d30164f25ea service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:50.927917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1199/2387] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:55.093214 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:55.099625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:55.161944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7d416-e8df-4046-a13c-70c818bc202a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:55.167086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:55.167985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:55.168313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:55.168571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] PATH_INFO: `/v3/users/94919f54214f4a8aa3398fb429317c2e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:55.169839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94919f54214f4a8aa3398fb429317c2e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:55.171787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:55.223805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94919f54214f4a8aa3398fb429317c2e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.234612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94919f54214f4a8aa3398fb429317c2e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.235549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94919f54214f4a8aa3398fb429317c2e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.236281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94919f54214f4a8aa3398fb429317c2e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.251769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94919f54214f4a8aa3398fb429317c2e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.266555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1189/2388] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:55 2022] DELETE /identity/v3/users/94919f54214f4a8aa3398fb429317c2e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:55.272013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:55.272504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:55.272618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:55.291352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:55.292597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:55.361251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1200/2389] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:55.371013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:55.372566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:55.430239 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05335f4-bf62-416e-8eca-0ab7ced4bbe2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:55.434149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:55.434803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:55.435081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:55.435338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:55.445350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:55.446797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:55.456969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1190/2390] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:55.736060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:55.737681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:55.750349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ccb4c-eaff-443b-b533-fb1f09cdac84 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:55.756006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:55.757073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:55.757356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:55.757689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] PATH_INFO: `/v3/projects/68bf1cfd304c4f91a2f35415a73bd140` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:55.758998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bf1cfd304c4f91a2f35415a73bd140)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:55.761043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:55.814618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bf1cfd304c4f91a2f35415a73bd140', 'request_id': 'req-c8936cba-5845-42c1-8b04-94bc27cc14ff'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.820906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bf1cfd304c4f91a2f35415a73bd140', 'request_id': 'req-c8936cba-5845-42c1-8b04-94bc27cc14ff'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.829683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bf1cfd304c4f91a2f35415a73bd140', 'request_id': 'req-c8936cba-5845-42c1-8b04-94bc27cc14ff'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.841308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] The token cache is being invalidate because project 68bf1cfd304c4f91a2f35415a73bd140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:55.841635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.842270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.844165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1201/2391] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:55 2022] DELETE /identity/v3/projects/68bf1cfd304c4f91a2f35415a73bd140 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:55.848036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:55.858054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215c9d3c-4388-4dcc-8ce2-608ae701db48 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:55.882684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:55.918260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:55.919147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:55.919428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:55.919688 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] PATH_INFO: `/v3/users/986f914790624e48bbd5898f9603f0a0` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:55.920942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] RBAC: Authorizing `identity:delete_user(user_id=986f914790624e48bbd5898f9603f0a0)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:55.922899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:55.976840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986f914790624e48bbd5898f9603f0a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.985777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986f914790624e48bbd5898f9603f0a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.986460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986f914790624e48bbd5898f9603f0a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.987116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986f914790624e48bbd5898f9603f0a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:55.998651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3baaf337-35f6-458e-869d-ba07faa57faf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986f914790624e48bbd5898f9603f0a0'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.011590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1191/2392] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:11:55 2022] DELETE /identity/v3/users/986f914790624e48bbd5898f9603f0a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:56.292564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.294116 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:56.309051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8936cba-5845-42c1-8b04-94bc27cc14ff admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.367907 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.368823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.369083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.369378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] PATH_INFO: `/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.370590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3ece0232974c49bb2f5b2c7b2a4bb4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.372601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.393515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:56.420497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3ece0232974c49bb2f5b2c7b2a4bb4', 'request_id': 'req-ec666e7d-e08d-4fd8-b4f8-ea9741715369'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.426459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3ece0232974c49bb2f5b2c7b2a4bb4', 'request_id': 'req-ec666e7d-e08d-4fd8-b4f8-ea9741715369'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.435536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3ece0232974c49bb2f5b2c7b2a4bb4', 'request_id': 'req-ec666e7d-e08d-4fd8-b4f8-ea9741715369'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.445817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] The token cache is being invalidate because project 4c3ece0232974c49bb2f5b2c7b2a4bb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:11:56.446095 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.446756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ec666e7d-e08d-4fd8-b4f8-ea9741715369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:11:56.448330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1202/2393] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:11:56 2022] DELETE /identity/v3/projects/4c3ece0232974c49bb2f5b2c7b2a4bb4 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:56.453763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.454227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.454333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.472113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:56.473429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:56.535954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1192/2394] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:56.543639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.543930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.544232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.563369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:56.564672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:56.573439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1203/2395] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:56.577968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.589464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9da075-53aa-4d40-b283-dba21559e3a2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.594198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.594892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.595168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.595436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.596335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:11:56.596637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.598260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.610374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1193/2396] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:11:56.614845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.624203 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b62b4e-5609-4b6a-991b-99ff3a68a573 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.629218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.629877 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.630160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.630477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.631181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.633148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.659496 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1204/2397] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:56 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:56.663527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.675237 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac5439-d591-4948-ac74-cf8993886b0c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.705108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:56.732196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.732799 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.733074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.733350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.734055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.735965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.756765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1194/2398] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:56 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:56.761209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.771729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9724658-1f39-4ecb-92ee-a152b45c0d61 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.776559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.777217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.777494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.777765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.778490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.780105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.791430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1205/2399] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:56.795653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.806388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed826801-3c0a-48dd-9b18-47767500751c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.812460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.813126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.813400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.813665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.814408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.816045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce73b1-666d-4691-89cc-83fc3f4efc16 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.826904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1195/2400] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:56.831117 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:56.841833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669cd15-e198-4fc9-b81f-4024301fb575 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:56.846687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:56.847563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.847823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.848106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] PATH_INFO: `/v3/projects/e8f9052e18c84ac58bb1b17e5d015fcc/users/e17a4214eaa34a0b9353df76482fee25/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.864215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f9052e18c84ac58bb1b17e5d015fcc, user_id=e17a4214eaa34a0b9353df76482fee25, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:56.866908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:56.882482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1206/2401] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:56 2022] PUT /identity/v3/projects/e8f9052e18c84ac58bb1b17e5d015fcc/users/e17a4214eaa34a0b9353df76482fee25/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:56.892572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:56.892854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:56.893130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:56.927359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] MFA Rules not processed for user `e17a4214eaa34a0b9353df76482fee25`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:56.928628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:56.997645 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1196/2402] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:57.002231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.066276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e8c739-ce05-40ad-9af1-1fe6871749f6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.071671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.072362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.072639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.072918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.073604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.075844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.103805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1207/2403] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/projects => generated 377 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:57.108161 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.119024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c20fa9-4462-4805-b451-83679ce60d4f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.178583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.179270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.179552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.179827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.180580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.182514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.204938 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1197/2404] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:57.209216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.219718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c541ed-a806-4b61-acbe-4fb4176b9d18 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.224654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.225322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.225606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.225880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.226613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.228278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.239963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1208/2405] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:57.244211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.254700 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cfca7-a7ac-4458-8dfe-bafb7247fe9d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.259513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.260206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.260488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.260817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.261554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.263198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55ec4ce-d6fa-4dfb-8d36-e8bcaebf36ae admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.273641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1198/2406] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:57.278011 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.288524 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da1fd7-5a22-43ee-b3ad-db20cdc9a3dc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.293704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.294584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.294864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.295135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] PATH_INFO: `/v3/projects/b8857499710b4834b2b6166fdb9ead7f/users/96b5d72f793e459186a94b871bd743a9/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.311508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8857499710b4834b2b6166fdb9ead7f, user_id=96b5d72f793e459186a94b871bd743a9, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.314190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.316446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:57.331136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1209/2407] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:57 2022] PUT /identity/v3/projects/b8857499710b4834b2b6166fdb9ead7f/users/96b5d72f793e459186a94b871bd743a9/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:57.342969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.343253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.343529 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.371126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] MFA Rules not processed for user `96b5d72f793e459186a94b871bd743a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:57.372394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:57.380797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:57.439564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1199/2408] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:11:57.444322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.508285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce170680-b495-4e69-a950-469b249dd207 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.513329 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.514007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.514290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.514562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.515278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.517233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.542499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1210/2409] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:11:57.546690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.557665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66b86d0-2882-4787-b7ae-c5d3a72a2e3c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.621806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.622498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.622782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.623055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.623822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.625806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.648933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1200/2410] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:11:57.656310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.667122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5450954-99bc-4cd8-8ff3-1a14d7c82023 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.673025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.673709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.674026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.674292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.675044 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.676818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.688651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1211/2411] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:57.693251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.704852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b87dcd-b7d8-42cc-902b-8eeab55dc522 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.710254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.711337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.711669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.711971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] PATH_INFO: `/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba/users/f607d694ddf74ac38d60fb8a02fc445e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.728649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa515d4fd8f4006859a9134fe4a94ba, user_id=f607d694ddf74ac38d60fb8a02fc445e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.731397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.745036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1201/2412] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:57 2022] PUT /identity/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba/users/f607d694ddf74ac38d60fb8a02fc445e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:11:57.749016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.758980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3486f5-5655-4c27-9ca1-2aa056ddaaea admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.821076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.821762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.822033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.822301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.823024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.824686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd966438-16ca-43d4-bc7e-60bf43c88a4d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.835659 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1212/2413] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:11:57.841520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:57.852050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ebc9e-a64f-4550-9ed5-6bb2217ffe38 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:57.857398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:57.858283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.858587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.858877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] PATH_INFO: `/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba/users/f607d694ddf74ac38d60fb8a02fc445e/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.861193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa515d4fd8f4006859a9134fe4a94ba, user_id=f607d694ddf74ac38d60fb8a02fc445e, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:57.863992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:57.874756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1202/2414] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:11:57 2022] PUT /identity/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba/users/f607d694ddf74ac38d60fb8a02fc445e/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:11:57.885600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:57.885887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:57.886151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:57.912893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] MFA Rules not processed for user `f607d694ddf74ac38d60fb8a02fc445e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:11:57.914071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:57.972682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:11:57.993343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1213/2415] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:11:58.005562 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:58.007426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:58.065551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72cd80-f267-47b8-a10a-340da61cae08 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:58.069944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:58.070581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:58.070855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:58.071120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:58.081122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:58.082595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:58.092177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1203/2416] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:11:58.134672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:11:58.136062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:11:58.148828 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a352e-a019-48da-b4e5-1d5a39c9655b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:11:58.153448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:11:58.154091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:11:58.154365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:11:58.154630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:11:58.215342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:11:58.216844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59f1d5c-de98-4515-bc39-e9f4caa944b2 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:11:58.227155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1214/2417] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:11:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:01.125837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:01.133327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:01.191552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546caa-cd35-49d3-8e6a-9fefdf050a24 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:01.196387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:01.197206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:01.197483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:01.197755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] PATH_INFO: `/v3/users/e17a4214eaa34a0b9353df76482fee25` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:01.198960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e17a4214eaa34a0b9353df76482fee25)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:01.201285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:01.251012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e17a4214eaa34a0b9353df76482fee25'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.259413 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e17a4214eaa34a0b9353df76482fee25'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.260135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e17a4214eaa34a0b9353df76482fee25'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.260742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e17a4214eaa34a0b9353df76482fee25'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.273145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e17a4214eaa34a0b9353df76482fee25'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.286313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1204/2418] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:12:01 2022] DELETE /identity/v3/users/e17a4214eaa34a0b9353df76482fee25 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:01.291263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:01.291748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:01.291880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:01.311097 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:01.312351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:01.374077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1215/2419] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:01.384193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:01.385769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:01.447853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99966bf4-c310-4e37-b6b8-a647a51cd06d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:01.452466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:01.453110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:01.453375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:01.453708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:01.463839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:01.465324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:01.475299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1205/2420] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:01.744545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:01.746001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:01.760885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad5a3d-5558-4e6b-be93-d87634a7e04f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:01.767535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:01.768588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:01.768931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:01.769266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] PATH_INFO: `/v3/projects/e8f9052e18c84ac58bb1b17e5d015fcc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:01.770788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f9052e18c84ac58bb1b17e5d015fcc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:01.773038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:01.829363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f9052e18c84ac58bb1b17e5d015fcc', 'request_id': 'req-b94f35ad-37bd-45b2-aa64-9f69253fd9db'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.836046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f9052e18c84ac58bb1b17e5d015fcc', 'request_id': 'req-b94f35ad-37bd-45b2-aa64-9f69253fd9db'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.846375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f9052e18c84ac58bb1b17e5d015fcc', 'request_id': 'req-b94f35ad-37bd-45b2-aa64-9f69253fd9db'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.858290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] The token cache is being invalidate because project e8f9052e18c84ac58bb1b17e5d015fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:12:01.858573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.859233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:01.860850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1216/2421] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:12:01 2022] DELETE /identity/v3/projects/e8f9052e18c84ac58bb1b17e5d015fcc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:01.864916 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:01.874971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f21d97-89ce-431f-8b4b-f47c2ebc2ee1 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:01.899614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:01.938510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:01.939398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:01.939681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:01.939957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] PATH_INFO: `/v3/users/96b5d72f793e459186a94b871bd743a9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:01.941330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96b5d72f793e459186a94b871bd743a9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:01.943331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:01.996299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96b5d72f793e459186a94b871bd743a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.006337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96b5d72f793e459186a94b871bd743a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.007353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96b5d72f793e459186a94b871bd743a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.008595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96b5d72f793e459186a94b871bd743a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.026573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96b5d72f793e459186a94b871bd743a9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.039449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1206/2422] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:12:01 2022] DELETE /identity/v3/users/96b5d72f793e459186a94b871bd743a9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:02.328708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:02.330314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:02.345164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f35ad-37bd-45b2-aa64-9f69253fd9db admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:02.355030 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:02.409368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:02.410263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:02.410541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:02.410834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] PATH_INFO: `/v3/projects/b8857499710b4834b2b6166fdb9ead7f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:02.412068 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8857499710b4834b2b6166fdb9ead7f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:02.414074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:02.462142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8857499710b4834b2b6166fdb9ead7f', 'request_id': 'req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.468240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8857499710b4834b2b6166fdb9ead7f', 'request_id': 'req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.477398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8857499710b4834b2b6166fdb9ead7f', 'request_id': 'req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.487932 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] The token cache is being invalidate because project b8857499710b4834b2b6166fdb9ead7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:12:02.488274 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.488909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.490477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1217/2423] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:12:02 2022] DELETE /identity/v3/projects/b8857499710b4834b2b6166fdb9ead7f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:02.494698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:02.496146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:02.509717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81014ccd-5b6a-4ef0-b76a-238ea1b6c7f3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:02.568134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:02.569138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:02.569419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:02.569687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] PATH_INFO: `/v3/users/f607d694ddf74ac38d60fb8a02fc445e` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:02.570981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f607d694ddf74ac38d60fb8a02fc445e)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:02.572949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:02.623823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f607d694ddf74ac38d60fb8a02fc445e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.625528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:02.637330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f607d694ddf74ac38d60fb8a02fc445e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.637926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f607d694ddf74ac38d60fb8a02fc445e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.638629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f607d694ddf74ac38d60fb8a02fc445e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.655054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-6028bc4f-cf1e-4990-83e4-890747969ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f607d694ddf74ac38d60fb8a02fc445e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:02.668391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1207/2424] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:12:02 2022] DELETE /identity/v3/users/f607d694ddf74ac38d60fb8a02fc445e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:12:02.949575 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:02.951502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:02.964594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f00ec-4cdc-4d11-95c9-108b0b3c1fc1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.026947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.027893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.028207 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.028483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] PATH_INFO: `/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.029742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa515d4fd8f4006859a9134fe4a94ba)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.031681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.080449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:03.085326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa515d4fd8f4006859a9134fe4a94ba', 'request_id': 'req-3a9bc16b-132d-44fc-8d80-914f122295f7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:03.094709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa515d4fd8f4006859a9134fe4a94ba', 'request_id': 'req-3a9bc16b-132d-44fc-8d80-914f122295f7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:03.103288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa515d4fd8f4006859a9134fe4a94ba', 'request_id': 'req-3a9bc16b-132d-44fc-8d80-914f122295f7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:03.114951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] The token cache is being invalidate because project 5fa515d4fd8f4006859a9134fe4a94ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:12:03.115268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:03.115947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a9bc16b-132d-44fc-8d80-914f122295f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:03.117661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1218/2425] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:12:02 2022] DELETE /identity/v3/projects/5fa515d4fd8f4006859a9134fe4a94ba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:03.124968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.125260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.125534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.146026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:03.147282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:03.207510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1208/2426] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:03.220717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.221037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.221307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.242414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:03.243623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:03.253092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1219/2427] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:03.257522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.267628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5668b-dae5-42b5-bada-d9d137da1b4b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.272724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.273383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.273665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.273940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.274709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:12:03.275012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.276629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.288662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1209/2428] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:12:03.293132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.302590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8b4d8-8a08-4852-bd7d-f069f87c1768 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.307758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.308469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.308747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.309012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.309711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.311611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.340892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1220/2429] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:12:03 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:12:03.345280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.355324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be215eb5-7a4b-46da-a119-db7260123116 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.414272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.414939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.415218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.415488 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.416186 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.418139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.439833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1210/2430] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:12:03 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:12:03.446291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.461732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468e1cc-299f-452a-9881-e67fa27a2fce admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.466744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.467414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.467687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.467952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.468864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.470475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.481475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1221/2431] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:12:03.486782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.497159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603acbc8-a510-4c80-8a95-9bae03b12b2f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.502996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.503657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.503939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.504208 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.504972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.506570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea3c6-947a-47f4-a539-d251a799860d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.519025 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1211/2432] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:12:03.523307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.534570 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa592d99-b817-47e4-9471-cf132109c797 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.540264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.541152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.541344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.541633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] PATH_INFO: `/v3/projects/bdf5c69ef0284d8abd199795b641e7fe/users/ff2a6ba2e75f4d809b6bdd1152bc5b46/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.557179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf5c69ef0284d8abd199795b641e7fe, user_id=ff2a6ba2e75f4d809b6bdd1152bc5b46, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.559832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.574103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1222/2433] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:12:03 2022] PUT /identity/v3/projects/bdf5c69ef0284d8abd199795b641e7fe/users/ff2a6ba2e75f4d809b6bdd1152bc5b46/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:03.579476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ca1-e4f7-4380-8444-30928ed7d29d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.579778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ca1-e4f7-4380-8444-30928ed7d29d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.580046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ca1-e4f7-4380-8444-30928ed7d29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.596856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-2e9a5ca1-e4f7-4380-8444-30928ed7d29d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:03.598053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2e9a5ca1-e4f7-4380-8444-30928ed7d29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:03.623943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:03.661888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1212/2434] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:03.671722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:03.673649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:03.739870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581732-6ac0-4b9f-b157-d9f0a30214ba admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:03.743902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:03.744584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:03.744857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:03.745126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:03.754431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:03.755899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:03.765528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1223/2435] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:04.393553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.393866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.394150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.421609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] MFA Rules not processed for user `ff2a6ba2e75f4d809b6bdd1152bc5b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:04.422948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:04.488169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1213/2436] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:04.492543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.503096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af65d559-7f77-4e2c-8ef8-715b134c61f4 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.508229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.508940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.509228 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.509489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.510271 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.512261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.539998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1224/2437] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:12:04 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:12:04.544284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.555728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850a56f0-6ea1-4035-8247-09db1534382a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.614840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.615523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.615796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.616059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.616815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.618758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.638988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1214/2438] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:12:04 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:12:04.643182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.654128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264964f6-c478-443b-89db-120cc7725ff0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.659919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.660616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.660887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.661152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.661882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.663515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.674832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1225/2439] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:12:04.679070 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.689394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c29947-9a71-407f-92d9-9e677be9af04 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.694449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.695325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.695596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.695890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] PATH_INFO: `/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2/users/97c43123e1ae4280a850b4c105adda04/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.711163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7e0f25c14b41b39eec0a54ff8874d2, user_id=97c43123e1ae4280a850b4c105adda04, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.713866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.732653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1215/2440] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:12:04 2022] PUT /identity/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2/users/97c43123e1ae4280a850b4c105adda04/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:12:04.736827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.747188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50b91-4683-4568-b773-1164515ad008 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.780868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:04.806511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.807275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.807569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.807823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.808588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.810208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb701b7f-3464-476d-80a1-84fba27ebcce admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.820213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1226/2441] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:12:04.825156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:04.836556 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4159f0-f61f-4432-9213-f1e65b539752 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:04.842361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:04.843251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:04.843534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:04.843812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] PATH_INFO: `/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2/users/97c43123e1ae4280a850b4c105adda04/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:04.845882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae7e0f25c14b41b39eec0a54ff8874d2, user_id=97c43123e1ae4280a850b4c105adda04, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:04.848587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677c9003-8b99-4c7b-9ab1-ea3d033e5f44 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:04.859491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1216/2442] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:12:04 2022] PUT /identity/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2/users/97c43123e1ae4280a850b4c105adda04/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:05.491053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b434-e063-42a9-acff-adc45c10245e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:05.491388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b434-e063-42a9-acff-adc45c10245e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:05.491632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361b434-e063-42a9-acff-adc45c10245e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:05.522516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b361b434-e063-42a9-acff-adc45c10245e None None] MFA Rules not processed for user `97c43123e1ae4280a850b4c105adda04`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:05.523990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b361b434-e063-42a9-acff-adc45c10245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:05.597922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1227/2443] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:05.610386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:05.610909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:05.610909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:05.629105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] MFA Rules not processed for user `ff2a6ba2e75f4d809b6bdd1152bc5b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:05.630332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:05.639066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:05.688027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1217/2444] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:05.702527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b434-e063-42a9-acff-adc45c10245e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:05.704343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b361b434-e063-42a9-acff-adc45c10245e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:05.782433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361b434-e063-42a9-acff-adc45c10245e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:05.789678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:05.790348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:05.790623 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:05.790891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:05.799970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:05.801600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:05.812931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1228/2445] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:06.857142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:06.858828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:06.932111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46aa4a-d990-4dc7-82de-38318750e70d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:06.937939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:06.938612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:06.938894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:06.939168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:06.941310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:06.953901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:06.955533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:06.965770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1218/2446] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:15.808608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=80 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:16.961308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=51 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:21.120584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:21.122276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:21.189261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b9b5-e0a2-4ee9-ad5b-6f22db9c334b service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:21.193777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:21.194868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:21.195174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:21.195529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:21.206219 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:21.207678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:21.217382 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1229/2447] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:31.213566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=26 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:37.733257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:37.802260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeea550-4782-41a1-9d83-683dadd4c3d5 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:37.807120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:37.808091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:37.808399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:37.809004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:37.811325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:37.823906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:37.825967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:37.834542 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1219/2448] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:12:40.651545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:40.653043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:40.668336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360db7c3-6b2d-41a5-b233-51f23d9b3773 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:40.674213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:40.674890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:40.675168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:40.675466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:40.677558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:40.689737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:40.691407 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:40.703716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1230/2449] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:12:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:12:41.231675 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:41.299496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e932f7c-dd5b-471e-9688-9e1968fbe5be service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:41.304525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:41.305397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:41.305674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:41.305947 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] PATH_INFO: `/v3/users/ff2a6ba2e75f4d809b6bdd1152bc5b46` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:41.307206 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2a6ba2e75f4d809b6bdd1152bc5b46)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:41.309183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:41.363798 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2a6ba2e75f4d809b6bdd1152bc5b46'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.371828 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2a6ba2e75f4d809b6bdd1152bc5b46'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.372441 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2a6ba2e75f4d809b6bdd1152bc5b46'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.373240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2a6ba2e75f4d809b6bdd1152bc5b46'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.384901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2a6ba2e75f4d809b6bdd1152bc5b46'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.396851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1220/2450] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:12:41 2022] DELETE /identity/v3/users/ff2a6ba2e75f4d809b6bdd1152bc5b46 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:41.796235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:41.807467 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21657a62-17ea-48a0-b8d5-94f430ba02c6 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:41.881656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:41.882851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:41.883126 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:41.883396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] PATH_INFO: `/v3/projects/bdf5c69ef0284d8abd199795b641e7fe` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:41.884691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf5c69ef0284d8abd199795b641e7fe)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:41.886711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:41.943270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf5c69ef0284d8abd199795b641e7fe', 'request_id': 'req-8aea1579-df31-4365-b909-7dd6d1867f94'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.949388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf5c69ef0284d8abd199795b641e7fe', 'request_id': 'req-8aea1579-df31-4365-b909-7dd6d1867f94'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.959662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf5c69ef0284d8abd199795b641e7fe', 'request_id': 'req-8aea1579-df31-4365-b909-7dd6d1867f94'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.972459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] The token cache is being invalidate because project bdf5c69ef0284d8abd199795b641e7fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:12:41.972739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.973356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:41.975003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1231/2451] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:12:41 2022] DELETE /identity/v3/projects/bdf5c69ef0284d8abd199795b641e7fe => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:41.979116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:41.980584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:41.993603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e178a-0a03-4376-84cf-85fb11f8bee0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:42.012674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:42.053993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:42.054863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:42.055136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:42.055397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] PATH_INFO: `/v3/users/97c43123e1ae4280a850b4c105adda04` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:42.056631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97c43123e1ae4280a850b4c105adda04)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:42.058544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:42.108716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97c43123e1ae4280a850b4c105adda04'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.117589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97c43123e1ae4280a850b4c105adda04'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.118241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97c43123e1ae4280a850b4c105adda04'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.118855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97c43123e1ae4280a850b4c105adda04'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.136183 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-18dc1a15-7a3b-4693-a6d8-5a5ad9647993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97c43123e1ae4280a850b4c105adda04'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.150287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1221/2452] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:12:41 2022] DELETE /identity/v3/users/97c43123e1ae4280a850b4c105adda04 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:42.341864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:12:42.343416 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:42.356593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea1579-df31-4365-b909-7dd6d1867f94 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:12:42.413050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:12:42.413924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:42.414193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:42.414466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] PATH_INFO: `/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:42.415631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae7e0f25c14b41b39eec0a54ff8874d2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:12:42.417611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:12:42.437787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:42.464465 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7e0f25c14b41b39eec0a54ff8874d2', 'request_id': 'req-6ac25779-91a4-4cb0-a43c-dee20f054540'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.470442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7e0f25c14b41b39eec0a54ff8874d2', 'request_id': 'req-6ac25779-91a4-4cb0-a43c-dee20f054540'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.477793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7e0f25c14b41b39eec0a54ff8874d2', 'request_id': 'req-6ac25779-91a4-4cb0-a43c-dee20f054540'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.488155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] The token cache is being invalidate because project ae7e0f25c14b41b39eec0a54ff8874d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:12:42.488438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.489055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6ac25779-91a4-4cb0-a43c-dee20f054540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:12:42.490617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1232/2453] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:12:42 2022] DELETE /identity/v3/projects/ae7e0f25c14b41b39eec0a54ff8874d2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:12:49.767808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:12:49.768409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:12:49.768409 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:12:49.786426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] MFA Rules not processed for user `82a27d0525d942d99b3c5b19971208dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:12:49.787729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:12:49.850690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1222/2454] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:12:52.485174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:12:59.838680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=68,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:11.059076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022b6d-6022-49e0-8d10-84db1946e8d3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:11.059556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022b6d-6022-49e0-8d10-84db1946e8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:11.059667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea022b6d-6022-49e0-8d10-84db1946e8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:11.078823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ea022b6d-6022-49e0-8d10-84db1946e8d3 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:13:11.080043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea022b6d-6022-49e0-8d10-84db1946e8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:11.136014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1233/2455] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:13:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:13:11.189887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:13:11.191313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:11.259582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f5596-352d-40ef-b07f-12ccd64350c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:13:11.264841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:13:11.265544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:11.265820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:11.266065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:11.274375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:13:11.275982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:13:11.284029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1223/2456] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:13:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:13:21.128834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=25 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:21.280960 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=32 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:33.790624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355939b0-b270-4273-8ebc-3cf616d28337 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:33.791124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355939b0-b270-4273-8ebc-3cf616d28337 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:33.791124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355939b0-b270-4273-8ebc-3cf616d28337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:33.813033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-355939b0-b270-4273-8ebc-3cf616d28337 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:13:33.814390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-355939b0-b270-4273-8ebc-3cf616d28337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:33.822615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1234/2457] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:13:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:13:33.840994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:13:33.854017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e18fc2-f18e-4f89-9bcf-cd52f51babc9 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:13:33.863647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:13:33.864382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:33.864662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:33.864931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:33.877540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:13:33.879270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:13:33.894504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1224/2458] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:13:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:13:43.807592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:43.888579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:13:57.431921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:57.432479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:57.432580 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:57.458033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:13:57.458033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:57.460090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1235/2459] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:13:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:13:57.472844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:13:57.484030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a220828-3f19-40a9-9bb6-a4dabf7c5631 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:13:57.489279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:13:57.489919 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:57.490191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:57.490458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:57.498530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:13:57.500162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:13:57.508222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1225/2460] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:13:58.568776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:13:58.570322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:58.647983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d7d3-9f27-4239-b0ae-99bb75f42c2c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:13:58.653029 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:13:58.653691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:58.653966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:58.654235 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:58.656047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:58.723186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:13:58.724619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:13:58.734349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1236/2461] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:13:59.179372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:13:59.193755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f200a-b2c8-441c-9ea7-d30500ff2f2d service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:13:59.198625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:13:59.199307 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:13:59.199591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:13:59.199833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:13:59.202338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:13:59.277826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:13:59.279278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:13:59.290573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1226/2462] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:13:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:02.083165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.085242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:02.098796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47e43-b9a9-4666-8658-9688bf4b9616 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.103627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.104582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.104885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.105153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] PATH_INFO: `/v3/users/029553978cc8405294ccb302665edbe2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.120296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=029553978cc8405294ccb302665edbe2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.122256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.169027 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '029553978cc8405294ccb302665edbe2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.177363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '029553978cc8405294ccb302665edbe2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.189350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '029553978cc8405294ccb302665edbe2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.189998 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '029553978cc8405294ccb302665edbe2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.190615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6fbc7f63-e67d-40bf-bb45-991c448311a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '029553978cc8405294ccb302665edbe2'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.203419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1237/2463] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:14:02 2022] DELETE /identity/v3/users/029553978cc8405294ccb302665edbe2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:02.387448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.401145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f884f5f-ef8a-48bb-8c77-8c2d2e6af800 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.460094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.461029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.461304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.461571 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] PATH_INFO: `/v3/projects/ec5ed999a41349d599d638e354a9702f` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.473035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec5ed999a41349d599d638e354a9702f)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.475018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.524358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec5ed999a41349d599d638e354a9702f', 'request_id': 'req-de06a663-bf73-4a85-a50c-68a70faace95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.532776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec5ed999a41349d599d638e354a9702f', 'request_id': 'req-de06a663-bf73-4a85-a50c-68a70faace95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.538564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec5ed999a41349d599d638e354a9702f', 'request_id': 'req-de06a663-bf73-4a85-a50c-68a70faace95'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.539677 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:02.552721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] The token cache is being invalidate because project ec5ed999a41349d599d638e354a9702f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:14:02.553131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.553901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de06a663-bf73-4a85-a50c-68a70faace95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:02.555513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1227/2464] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:14:02 2022] DELETE /identity/v3/projects/ec5ed999a41349d599d638e354a9702f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:02.560661 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575707de-65d5-4f02-9830-329080f59a57 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.560955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575707de-65d5-4f02-9830-329080f59a57 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.561256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575707de-65d5-4f02-9830-329080f59a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.569243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:02.581765 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-575707de-65d5-4f02-9830-329080f59a57 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:02.583703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-575707de-65d5-4f02-9830-329080f59a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:02.649015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1238/2465] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:14:02.662723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.663012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.663284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.682999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:02.684244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:02.694122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1228/2466] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:02.698940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575707de-65d5-4f02-9830-329080f59a57 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.711824 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575707de-65d5-4f02-9830-329080f59a57 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.717502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.718172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.718486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.718748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.719485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:14:02.719803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.721442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.733602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1239/2467] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:14:02.738167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.747667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d223d6-1c81-4e46-ba7f-c4dda1d3ad23 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.752930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.753570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.753846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.754112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.754800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.756742 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.788266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1229/2468] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:14:02 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:02.789390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.802231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959dba4d-c23b-4e21-bc78-67144db83e7e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.869923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.870640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.870921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.871212 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.871944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.874043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.896879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1240/2469] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:14:02 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:02.901195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.911773 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f448ca1-0348-4bfb-9530-98aa9d47f8a9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.916615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.917287 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.917564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.917830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.918532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.920216 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.930841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1230/2470] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:02.934823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.945249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093cb7-c3ec-459e-8cab-3a9c72ab1874 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.950852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.951525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.951796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.952060 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:02.952849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:02.954450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610a1a6-075f-46eb-99c5-b1790834ff7f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:02.964616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1241/2471] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:02.968814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:02.980013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb4038-02c1-4732-b4cb-8c07aa128fc3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:02.985300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:02.986207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:02.986476 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:02.986740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] PATH_INFO: `/v3/projects/7184c8f37a054d3c8ad4d96e82232cc5/users/307664014cb24ab48ecac910683d210b/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.002167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7184c8f37a054d3c8ad4d96e82232cc5, user_id=307664014cb24ab48ecac910683d210b, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.004957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.022196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1231/2472] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:02 2022] PUT /identity/v3/projects/7184c8f37a054d3c8ad4d96e82232cc5/users/307664014cb24ab48ecac910683d210b/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:03.032719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.033025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.033294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.061980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] MFA Rules not processed for user `307664014cb24ab48ecac910683d210b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:03.063118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:03.127361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:03.135687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1242/2473] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:03.136995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.198957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3948c18-4650-4da5-92e8-dab0a56e0551 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.204581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.205242 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.205518 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.205790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.206481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.208414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.235602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1232/2474] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:14:03 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:03.241630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.257141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea19fa-c4e7-44ac-b47f-d384dcad0115 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.315441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.316184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.316386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.316652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.317393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.319326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.344569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1243/2475] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:14:03 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:03.345830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.356744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e10d30-06b1-42ca-ae52-e5d671ee8602 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.362122 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.362819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.363098 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.364059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.364856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.366482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.377956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1233/2476] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:14:03.382308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.392900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ca437-a000-4dcf-ae39-dc89eaebeee9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.400739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.401968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.402369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.402733 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] PATH_INFO: `/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580/users/403c17b786984f5e85108712562c5f8b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.421261 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bf0afcc3b34393a9d8d1c2997ce580, user_id=403c17b786984f5e85108712562c5f8b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.423936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.439273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1244/2477] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:03 2022] PUT /identity/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580/users/403c17b786984f5e85108712562c5f8b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:03.443414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.454637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a22b0-40c7-4ed9-a99c-4817bb055867 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.514364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.515031 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.515302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.515567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.516319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.517910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12875d-474e-43d7-88b5-42ab6f627ce2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.522918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:03.528490 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1234/2478] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:03.532760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.543306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5e76d-2fd5-4733-be41-4a6cd9dce992 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.548073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.548988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.549258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.549523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] PATH_INFO: `/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580/users/403c17b786984f5e85108712562c5f8b/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.551553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=83bf0afcc3b34393a9d8d1c2997ce580, user_id=403c17b786984f5e85108712562c5f8b, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.554216 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.564620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1245/2479] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:03 2022] PUT /identity/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580/users/403c17b786984f5e85108712562c5f8b/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:03.574732 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.574966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.575569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.605399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] MFA Rules not processed for user `403c17b786984f5e85108712562c5f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:03.606628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:03.677831 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1235/2480] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:03.697335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.699454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:03.760859 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614843f-42c7-40ca-a2b6-ce47f07b89fd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.765013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.765655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.765928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.766218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.776552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.777985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.787532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1246/2481] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:03 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:03.872353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:03.882332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62065f3a-a680-438a-815f-873f43e772b2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:03.886021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:03.886655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:03.886920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:03.887195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:03.943839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:03.945356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b9a35c-53c8-4fce-a290-80d5ac61c565 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:03.954872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1236/2482] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:08.755359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:08.817110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:08.823875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a48fc8-4782-4fa1-aed6-434f4c420ccb service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:08.829559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:08.830513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:08.830734 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:08.831004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] PATH_INFO: `/v3/users/307664014cb24ab48ecac910683d210b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:08.832279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=307664014cb24ab48ecac910683d210b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:08.834198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:08.883640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '307664014cb24ab48ecac910683d210b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:08.892626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '307664014cb24ab48ecac910683d210b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:08.904989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '307664014cb24ab48ecac910683d210b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:08.905638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '307664014cb24ab48ecac910683d210b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:08.906332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '307664014cb24ab48ecac910683d210b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:08.919561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1247/2483] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:14:08 2022] DELETE /identity/v3/users/307664014cb24ab48ecac910683d210b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:08.924290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:08.924770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:08.924873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:08.942835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:08.944067 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:09.016046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1237/2484] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:09.027383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:09.028900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:09.086990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd803df5-e09f-4dda-b580-0a222ecdefa4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:09.090935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:09.091748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:09.092272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:09.092546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:09.102087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:09.103611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:09.113211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1248/2485] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:09.384875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:09.386400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:09.399428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd3c30-15ba-421b-ab19-1a95275082a4 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:09.405126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:09.406011 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:09.406292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:09.406565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] PATH_INFO: `/v3/projects/7184c8f37a054d3c8ad4d96e82232cc5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:09.407915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7184c8f37a054d3c8ad4d96e82232cc5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:09.409821 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:09.433782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:09.462132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7184c8f37a054d3c8ad4d96e82232cc5', 'request_id': 'req-7f73f402-7b64-4577-89e1-c6b189757717'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.471886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7184c8f37a054d3c8ad4d96e82232cc5', 'request_id': 'req-7f73f402-7b64-4577-89e1-c6b189757717'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.478492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7184c8f37a054d3c8ad4d96e82232cc5', 'request_id': 'req-7f73f402-7b64-4577-89e1-c6b189757717'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.490217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] The token cache is being invalidate because project 7184c8f37a054d3c8ad4d96e82232cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:14:09.490516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.491258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.493446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1238/2486] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:14:09 2022] DELETE /identity/v3/projects/7184c8f37a054d3c8ad4d96e82232cc5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:09.497960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:09.507841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7b5e-c5dd-4053-be02-3756ad67c301 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:09.566174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:09.567049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:09.567324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:09.567583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] PATH_INFO: `/v3/users/403c17b786984f5e85108712562c5f8b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:09.568814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=403c17b786984f5e85108712562c5f8b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:09.570736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:09.592836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:09.623584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '403c17b786984f5e85108712562c5f8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.631890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '403c17b786984f5e85108712562c5f8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.643879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '403c17b786984f5e85108712562c5f8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.644527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '403c17b786984f5e85108712562c5f8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.645132 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c539f249-c6b0-4f94-935a-0c5dfb866c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '403c17b786984f5e85108712562c5f8b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:09.658010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1249/2487] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:14:09 2022] DELETE /identity/v3/users/403c17b786984f5e85108712562c5f8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:09.936759 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:09.939039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:09.953033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73f402-7b64-4577-89e1-c6b189757717 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.011605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.012520 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.012777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.013047 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] PATH_INFO: `/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.014251 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83bf0afcc3b34393a9d8d1c2997ce580)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.016157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.065906 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83bf0afcc3b34393a9d8d1c2997ce580', 'request_id': 'req-780bbd1f-fbc4-414e-8827-347bd5359221'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.077187 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83bf0afcc3b34393a9d8d1c2997ce580', 'request_id': 'req-780bbd1f-fbc4-414e-8827-347bd5359221'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.084655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83bf0afcc3b34393a9d8d1c2997ce580', 'request_id': 'req-780bbd1f-fbc4-414e-8827-347bd5359221'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.098880 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] The token cache is being invalidate because project 83bf0afcc3b34393a9d8d1c2997ce580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:14:10.099173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.099881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-780bbd1f-fbc4-414e-8827-347bd5359221 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.101445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1239/2488] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:14:09 2022] DELETE /identity/v3/projects/83bf0afcc3b34393a9d8d1c2997ce580 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:10.107536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.108021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.108167 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.129784 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:10.130953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:10.201888 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1250/2489] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:14:10.209867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.210157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.210427 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.229990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:10.231200 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:10.240419 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1240/2490] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:10.244990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.255252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec671957-50df-4849-87f2-859f2d7aaf0e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.260090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.260806 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.261083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.261351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.262074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:14:10.262373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.263979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.276872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1251/2491] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:14:10.281387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.291179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae1a59-6c1c-4bb5-982c-2eedaa5874c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.297191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.297863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.298142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.298411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.299123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.301124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.330575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1241/2492] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:10.334967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.345365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb131a0-3f32-4617-a641-a1844d78b7c7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.405695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.406385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.406660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.406921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.407624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.409616 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.432755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1252/2493] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:14:10.436959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.447929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6cc383-8be4-4dd2-8c10-2945ae0bfd3a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.453758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.454364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.454636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.454898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.455659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.457272 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.459544 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:10.469693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1242/2494] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:10.473805 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.484179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0177d7d-cbd5-412f-a825-3881359c4810 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.489049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.489714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.489991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.490260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.490992 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.492645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b2d7d-f7d6-45e7-8847-e2a0600568a2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.502750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1253/2495] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:10.506856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.519069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02318af-5eeb-4d67-a076-bf5342e17701 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.527665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.529026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.529328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.529692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] PATH_INFO: `/v3/projects/6a7234b9599c4c719de140d7958be978/users/7fad5476b5d84b0fad48f7d706f17073/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.548657 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a7234b9599c4c719de140d7958be978, user_id=7fad5476b5d84b0fad48f7d706f17073, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.551297 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.566235 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1243/2496] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:10 2022] PUT /identity/v3/projects/6a7234b9599c4c719de140d7958be978/users/7fad5476b5d84b0fad48f7d706f17073/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:10.577376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.577662 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.577934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.584053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:10.607617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] MFA Rules not processed for user `7fad5476b5d84b0fad48f7d706f17073`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:10.608871 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:10.673664 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1254/2497] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:10.685150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.686973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:10.744561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e118d0-13bc-4fba-b816-f94ee24a8638 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.748429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.749081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.749354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.749625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.758062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.759605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec37fe9-842d-4ec5-95e9-f0de3c19b895 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.768313 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1244/2498] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:10.787738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:10.853513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8898384-18b2-4f58-8e41-444353fdba01 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:10.859109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:10.859991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.860295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.860566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] PATH_INFO: `/v3/users/7fad5476b5d84b0fad48f7d706f17073` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.861846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fad5476b5d84b0fad48f7d706f17073)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:10.863788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:10.922708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fad5476b5d84b0fad48f7d706f17073'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.930696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fad5476b5d84b0fad48f7d706f17073'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.943589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fad5476b5d84b0fad48f7d706f17073'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.944425 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fad5476b5d84b0fad48f7d706f17073'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.945151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fad5476b5d84b0fad48f7d706f17073'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:10.959229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1255/2499] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:14:10 2022] DELETE /identity/v3/users/7fad5476b5d84b0fad48f7d706f17073 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:10.963953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:10.964451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:10.964546 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:10.982448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:10.983656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:11.049946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1245/2500] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:11.060091 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.061692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:11.077494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:11.124747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a6683-01cf-4e9b-9b36-96a526d1120c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.129400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.130057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.130335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.130603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.141349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.142813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1428cc61-b071-4488-b863-1812c9ceb9b9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.153314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1256/2501] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:11.433813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.435397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:11.451017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3063dd-b054-44fa-aabb-37655c710dc1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.456907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.457920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.458267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.458609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] PATH_INFO: `/v3/projects/6a7234b9599c4c719de140d7958be978` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.459979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a7234b9599c4c719de140d7958be978)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.462746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.513353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a7234b9599c4c719de140d7958be978', 'request_id': 'req-7858cc22-b7cd-47c3-bc7e-b8b27552df58'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:11.523736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a7234b9599c4c719de140d7958be978', 'request_id': 'req-7858cc22-b7cd-47c3-bc7e-b8b27552df58'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:11.529446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a7234b9599c4c719de140d7958be978', 'request_id': 'req-7858cc22-b7cd-47c3-bc7e-b8b27552df58'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:11.537273 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:11.541270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] The token cache is being invalidate because project 6a7234b9599c4c719de140d7958be978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:14:11.541794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:11.542812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-7858cc22-b7cd-47c3-bc7e-b8b27552df58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:11.544844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1246/2502] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:14:11 2022] DELETE /identity/v3/projects/6a7234b9599c4c719de140d7958be978 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:11.549718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.550000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.550268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.568941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:11.570101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:11.629457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1257/2503] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:11.638343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.638633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.638905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.657614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:11.658827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:11.667619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1247/2504] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:11.671665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.683809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2401d23b-833c-4557-8d9d-35d8dc980c42 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.692613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.693552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.693850 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.694157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.695241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:14:11.695539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.697183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.713973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1258/2505] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:14:11.718604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.727942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20da740-946b-4d79-a206-03a0ab5aaa7f None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.732751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.733403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.733680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.733952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.734648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.736592 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.765953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1248/2506] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:14:11 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:11.770838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.782192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772c80e-d8f8-411f-a30e-a317d62c0d1f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.858787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.859365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.859637 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.859899 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.860595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.862537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.886403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1259/2507] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:14:11 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:14:11.890877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.901709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd991363-c89e-469e-ae77-43572750f045 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.906904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.907577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.907883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.908179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.908944 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.910581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.921548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1249/2508] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:14:11.925600 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.936462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee738439-f5fe-4cfc-bbe0-4bb0e87025e2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.942078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.942776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.943048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.943311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.944036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.945713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b59b2-82cc-48b7-8b7a-56025bf30854 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:11.956643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1260/2509] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:11.960952 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:11.971596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8066af-e9cc-4e6e-9c55-4e4672ab9e8f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:11.977060 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:11.977984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:11.978259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:11.978503 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] PATH_INFO: `/v3/projects/37d739d84a2844bfb321582af8ba02bf/users/cb9d079982b74f109520532b932fd6e9/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:11.994370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d739d84a2844bfb321582af8ba02bf, user_id=cb9d079982b74f109520532b932fd6e9, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:11.997048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:12.012701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1250/2510] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:11 2022] PUT /identity/v3/projects/37d739d84a2844bfb321582af8ba02bf/users/cb9d079982b74f109520532b932fd6e9/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:12.023141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:12.023424 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:12.023690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:12.050513 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] MFA Rules not processed for user `cb9d079982b74f109520532b932fd6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:12.051717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:12.062099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:12.124817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1261/2511] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:12.137380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:12.139134 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:12.203462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0c395-f9c6-474c-aa7f-8832e125fc71 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:12.207768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:12.208446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:12.208722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:12.208987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:12.217604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:12.219062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f813b-2ec9-45ce-b6b1-b1263b53c597 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:12.228155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1251/2512] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:22.121944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=23 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:22.223953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=53,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:25.845532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:25.910259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251189a8-54ec-4e9a-8de5-0dca618ca3ed None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:25.915234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:25.916148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:25.916437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:25.916699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] PATH_INFO: `/v3/users/cb9d079982b74f109520532b932fd6e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:25.917870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb9d079982b74f109520532b932fd6e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:25.919792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:25.969232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb9d079982b74f109520532b932fd6e9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:25.977825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb9d079982b74f109520532b932fd6e9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:25.990376 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb9d079982b74f109520532b932fd6e9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:25.991047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb9d079982b74f109520532b932fd6e9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:25.991752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb9d079982b74f109520532b932fd6e9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.004866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1262/2513] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:14:25 2022] DELETE /identity/v3/users/cb9d079982b74f109520532b932fd6e9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:26.009536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.010037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.010037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.028024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:26.029309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:26.093667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1252/2514] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:14:26.105878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.107414 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:26.174708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac3006-5366-4c69-84ea-b970b63414f3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.178947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.179608 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.179887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.180154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.190140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.191591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e5587-c6ff-4553-a040-020156afab9c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.201492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1263/2515] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:26.476229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.478120 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:26.491706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48166671-1bdb-4e9a-a67d-91e39fdeb818 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.497530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.498425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.499296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.499551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] PATH_INFO: `/v3/projects/37d739d84a2844bfb321582af8ba02bf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.501016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d739d84a2844bfb321582af8ba02bf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.503196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.551451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d739d84a2844bfb321582af8ba02bf', 'request_id': 'req-af5c2496-1cce-482d-b139-d45d9188e06b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.560483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d739d84a2844bfb321582af8ba02bf', 'request_id': 'req-af5c2496-1cce-482d-b139-d45d9188e06b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.566511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d739d84a2844bfb321582af8ba02bf', 'request_id': 'req-af5c2496-1cce-482d-b139-d45d9188e06b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.578507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] The token cache is being invalidate because project 37d739d84a2844bfb321582af8ba02bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:14:26.578792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.579469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-af5c2496-1cce-482d-b139-d45d9188e06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:14:26.581111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1253/2516] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:14:26 2022] DELETE /identity/v3/projects/37d739d84a2844bfb321582af8ba02bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:14:26.586419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.586699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.586969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.605173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:26.606366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:26.623415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:26.667965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1264/2517] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:14:26.676930 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.677329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.677693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.705006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:26.706212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:26.715282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1254/2518] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:26.719816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.730201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afedc7d8-5411-4d59-9860-fc0464eb79d3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.736165 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.736857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.737137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.737404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.738137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:14:26.738441 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.740102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.752193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1265/2519] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:14:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:14:26.756481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.765859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a855906-7b40-4c1a-a007-8b843c20a873 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.771117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.771768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.772044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.772331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.773029 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.774931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.804412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1255/2520] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:14:26 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:14:26.808697 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.819210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafad59-b93f-4f2b-afe8-7f593b36e882 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.880422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.881081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.881355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.881636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.882315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.884294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.904613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1266/2521] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:14:26 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:14:26.909081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.919663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b2a7e-3a93-43c5-8d0a-3cface3cadd3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.924743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.925422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.925703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.925976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.926859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.928515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.940172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1256/2522] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:26.944384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.955220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a0b6f-00d8-4f41-9b3f-bb25b0cb9a7d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.960418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.961080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.961355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.961610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:26.962333 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:26.963976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c39d95-fd5e-45c3-9a0b-07d6bdaf514a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:26.974392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1267/2523] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:14:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:14:26.978626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:26.989007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374c08d-3d73-40d2-ac0f-4caaa05c7056 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:26.994077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:26.994936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:26.995234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:26.995504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] PATH_INFO: `/v3/projects/db6ba823411041e6be5e26b11e06eb56/users/be7ebec8d17f4b8d88197ce47169e4ef/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:27.010826 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6ba823411041e6be5e26b11e06eb56, user_id=be7ebec8d17f4b8d88197ce47169e4ef, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:27.013531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:27.030879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1257/2524] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:14:26 2022] PUT /identity/v3/projects/db6ba823411041e6be5e26b11e06eb56/users/be7ebec8d17f4b8d88197ce47169e4ef/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:14:27.037760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33362-1eaf-4cbe-9f88-10f9f2f55702 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:27.038052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33362-1eaf-4cbe-9f88-10f9f2f55702 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:27.038330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f33362-1eaf-4cbe-9f88-10f9f2f55702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:27.056773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-30f33362-1eaf-4cbe-9f88-10f9f2f55702 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:27.057927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-30f33362-1eaf-4cbe-9f88-10f9f2f55702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:27.122544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1268/2525] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:27.132539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:27.134574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:27.157290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:27.195202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b31c2-4513-451f-bb98-bed7a224893c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:27.199842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:27.200896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:27.201172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:27.201454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:27.211492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:27.212957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:27.222672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1258/2526] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:27.852724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111c0d-971f-4e5c-aeb9-9094fd6f792c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:27.853012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111c0d-971f-4e5c-aeb9-9094fd6f792c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:27.853286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8111c0d-971f-4e5c-aeb9-9094fd6f792c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:27.879358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e8111c0d-971f-4e5c-aeb9-9094fd6f792c None None] MFA Rules not processed for user `be7ebec8d17f4b8d88197ce47169e4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:27.880603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e8111c0d-971f-4e5c-aeb9-9094fd6f792c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:27.898053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:27.956042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1269/2527] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:27.967048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:27.968500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:28.026929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1000f5-0d9e-4f16-9c17-89bd3fd76ead service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:28.030844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:28.031502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:28.031775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:28.032044 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:28.041055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:28.042497 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:28.051362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1259/2528] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:29.419187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:29.419647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:29.419740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:29.439221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] MFA Rules not processed for user `be7ebec8d17f4b8d88197ce47169e4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:29.440503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:29.448730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1270/2529] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:29.487908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:29.489573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:29.559977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e3ef-ada1-4ffe-8f37-79bb5c19dc72 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:29.563403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:29.564049 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:29.564356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:29.564619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:29.566641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:29.638194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:29.639632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00456d-a0a2-461e-9d8f-dacbe54cdc8a service glance] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:29.651153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1260/2530] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:31.915466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:31.926225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda4b06-33da-4dd1-82ea-916ad21e416c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:31.930630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:31.931276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:31.931578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:31.931866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:31.934332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:31.945214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:31.946676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:31.955636 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1271/2531] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:39.646690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:41.951717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=28 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:46.385361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:46.385908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:46.385908 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:46.404247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] MFA Rules not processed for user `be7ebec8d17f4b8d88197ce47169e4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:14:46.405462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:46.413650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1261/2532] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:14:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:14:56.399131 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:14:58.418387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:58.429127 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc5db6-4928-4119-b10f-e07f851a4af2 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:58.433166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:58.433901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:58.434240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:58.434577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:58.436516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:58.498066 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:58.499512 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:58.508841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1272/2533] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:14:59.506160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:14:59.509198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:59.524382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd6c90-6b6a-4952-8d1a-36c4fc483d0b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:14:59.528374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:14:59.529389 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:14:59.529884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:14:59.530345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:14:59.532553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:14:59.550643 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:14:59.552106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:14:59.563324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1262/2534] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:02.220332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:02.223351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:02.239962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46057641-b71f-4611-b7de-54c25c77a780 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:02.245894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bc257-ce03-4391-a196-88212773200a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:02.246809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bc257-ce03-4391-a196-88212773200a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:02.247299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bc257-ce03-4391-a196-88212773200a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:02.247724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56bc257-ce03-4391-a196-88212773200a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:02.249800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b56bc257-ce03-4391-a196-88212773200a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:02.272278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bc257-ce03-4391-a196-88212773200a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:02.278118 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56bc257-ce03-4391-a196-88212773200a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:02.324205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1273/2535] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:04.072331 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.073808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:04.088669 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68e2f3-e494-469e-9b85-5f97331b10cf service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.098612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.099634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.099915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.100228 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] PATH_INFO: `/v3/users/82a27d0525d942d99b3c5b19971208dc` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.117739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a27d0525d942d99b3c5b19971208dc)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.119866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.172666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a27d0525d942d99b3c5b19971208dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.181528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a27d0525d942d99b3c5b19971208dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.182394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a27d0525d942d99b3c5b19971208dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.183035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a27d0525d942d99b3c5b19971208dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.198399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c7c904cf-bfca-4689-808b-977b3d8bbe8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a27d0525d942d99b3c5b19971208dc'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.209737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1263/2536] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:04 2022] DELETE /identity/v3/users/82a27d0525d942d99b3c5b19971208dc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:04.398754 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bc257-ce03-4391-a196-88212773200a service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.420586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56bc257-ce03-4391-a196-88212773200a service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.493105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.494061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.494344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.494620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] PATH_INFO: `/v3/projects/47cf676545744501bdc403ce39dc9b5b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.505459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cf676545744501bdc403ce39dc9b5b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.507394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.562046 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cf676545744501bdc403ce39dc9b5b', 'request_id': 'req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.569186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cf676545744501bdc403ce39dc9b5b', 'request_id': 'req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.577829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cf676545744501bdc403ce39dc9b5b', 'request_id': 'req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.589628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] The token cache is being invalidate because project 47cf676545744501bdc403ce39dc9b5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:04.589908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.590531 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f599b80-eaf1-41e8-921a-6bffadf1a1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:04.592135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1274/2537] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:04 2022] DELETE /identity/v3/projects/47cf676545744501bdc403ce39dc9b5b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:04.597219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.597512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.597789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.617539 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:04.618832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:04.683740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1264/2538] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:04.691844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.692281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.692558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.706149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:04.712421 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:04.714214 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:04.723188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1275/2539] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:04.728575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.738116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1851-9293-4ed8-969d-615930bae1ea None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.743224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.743876 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.744146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.744445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.745167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:04.745467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.747051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.758836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1265/2540] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:04.763154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.772532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11fe79-49fb-4f9e-9e27-086f2bf23766 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.777440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.778082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.778353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.778619 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.779307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.781234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.812455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1276/2541] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:04 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:04.813543 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.826194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3803e703-a167-4de9-a3e5-f3a5e8c4f993 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.865611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:04.893096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.893787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.894065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.894335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.895037 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.897002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.918055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1266/2542] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:04 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:04.922346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.937188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9876324-fe1e-4e2b-82b9-34d0dcc4a591 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.942822 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.943851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.944169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.944444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.945178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.946905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.960161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1277/2543] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:04.962861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:04.973004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00b825-9d45-432f-a1bf-57559da81e12 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:04.978022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:04.978823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:04.979107 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:04.979381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:04.980113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:04.981749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58b470-f683-4785-aaf5-7d6f8e1a218f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:04.996159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1267/2544] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:05.000373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.011085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb700a-aa97-4bae-b661-88ab5ded4bfc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.015737 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.018880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.018880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.018880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] PATH_INFO: `/v3/projects/26be1b19466d4e00b0e4818164c256a8/users/65a5f51369144ab3b918210fcdd6f791/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.034845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] RBAC: Authorizing `identity:create_grant(project_id=26be1b19466d4e00b0e4818164c256a8, user_id=65a5f51369144ab3b918210fcdd6f791, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.037643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.052073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1278/2545] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:04 2022] PUT /identity/v3/projects/26be1b19466d4e00b0e4818164c256a8/users/65a5f51369144ab3b918210fcdd6f791/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:05.063582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.063853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.064145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.092815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] MFA Rules not processed for user `65a5f51369144ab3b918210fcdd6f791`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:05.094103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.166453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1268/2546] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:05.171294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.235663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.237191 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.252667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb4f9d-149a-4a89-ad6f-3830035a28de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.257259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.257973 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.258247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.258515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.259217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.261206 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.294558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1279/2547] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:05.300672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.313642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70451c-c1e7-40c5-a1cb-29395898334b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.377146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.377886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.378225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.378557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.380461 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.385026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a67c1-22be-4f07-b0a6-89c574fae00e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.389592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.390272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.390583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.390881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.391657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.392708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.393736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.394274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256c7556-cacc-4738-a674-2578b92b98aa service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.405348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1269/2548] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:05.406863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.407212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.407531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.413570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:05.420415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1280/2549] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:05.421517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.428314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:05.429517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.431790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c1698-578a-424d-a37c-eef99a311325 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.436446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.437110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.437385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.437655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.438373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.439960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.450587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1281/2550] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:05.455200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.466259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e2477-394a-4610-b91a-598add24512c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.472652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.473456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.475455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.475455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.475455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.476780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.478270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:05.495223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1270/2551] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:05.495737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.500304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1282/2552] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:05.509552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8bff76-4d72-4930-af9f-27193fefab7a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.516610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.517533 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.517810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.518078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] PATH_INFO: `/v3/projects/902e7ed2410d49cc965064dd4adcf1ca/users/96092f8bdca443d3a61b9c5f7c13fc39/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.536034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=902e7ed2410d49cc965064dd4adcf1ca, user_id=96092f8bdca443d3a61b9c5f7c13fc39, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.538962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc62d9-4a82-4a55-af0c-6d18684088fc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.552576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.554431 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1271/2553] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:05 2022] PUT /identity/v3/projects/902e7ed2410d49cc965064dd4adcf1ca/users/96092f8bdca443d3a61b9c5f7c13fc39/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:05.554560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.564270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.564558 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.564834 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.594479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] MFA Rules not processed for user `96092f8bdca443d3a61b9c5f7c13fc39`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:05.595686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:05.634383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a465c-2be8-44b0-8179-a9af61266a93 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.668217 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1272/2554] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:05.672517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.704602 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.705492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.705611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.706150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.742617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2de0ec-f99b-4753-b093-d8dea565796b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.748381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.749007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.749619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.749957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.752101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.754039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.767444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.769088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.775153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:05.778844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1283/2555] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 07 04:15:05.786548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1273/2556] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:05.791283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.803145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe716f-fcc1-46fa-b3dc-e0787bed3702 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.861861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:05.893723 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.894854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.895507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.896009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.897063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.899499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.933777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1284/2557] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:05 2022] POST /identity/v3/users => generated 300 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:05.935807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:05.956653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9044e-cd50-4499-b2d8-e3a830065449 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:05.963855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:05.965282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:05.965744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:05.966300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:05.967362 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:05.970033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:05.991851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:06.001375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1274/2558] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:05 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:06.006015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1d49d-5017-46cf-a5a4-44caa2b86680 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:06.010963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:06.012901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:06.012901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:06.012901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] PATH_INFO: `/v3/projects/928538d2e06046f495e52f50b1ee6095/users/3ec2bdb00f73471f820f7eaf0e003c56/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:06.046255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928538d2e06046f495e52f50b1ee6095, user_id=3ec2bdb00f73471f820f7eaf0e003c56, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:06.055711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:06.097922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1285/2559] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:05 2022] PUT /identity/v3/projects/928538d2e06046f495e52f50b1ee6095/users/3ec2bdb00f73471f820f7eaf0e003c56/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:06.102336 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:06.115359 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3c743-4a11-4133-af64-b9c4bb728e1d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:06.223946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:06.224736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:06.225016 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:06.225286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:06.228179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:06.230248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d73878-78eb-4d43-9281-86befaffd224 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:06.244948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1275/2560] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:06.252539 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:06.266553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71c583-bb4e-4435-947a-ae9327ae7176 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:06.271903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:06.272844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:06.273115 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:06.273384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] PATH_INFO: `/v3/projects/928538d2e06046f495e52f50b1ee6095/users/3ec2bdb00f73471f820f7eaf0e003c56/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:06.275556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928538d2e06046f495e52f50b1ee6095, user_id=3ec2bdb00f73471f820f7eaf0e003c56, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:06.278250 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:06.291291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1286/2561] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:06 2022] PUT /identity/v3/projects/928538d2e06046f495e52f50b1ee6095/users/3ec2bdb00f73471f820f7eaf0e003c56/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:06.302627 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:06.302905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:06.303184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:06.342151 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] MFA Rules not processed for user `3ec2bdb00f73471f820f7eaf0e003c56`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:06.343507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:06.444913 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1276/2562] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:06.457750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:06.459896 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:06.569660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f153374-669c-4085-8d25-3a100f351c80 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:06.574200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:06.574866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:06.575142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:06.575724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:06.585926 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:06.588172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:06.598520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1287/2563] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:07.640275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:07.642433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:07.663808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d8551-c5f8-44b3-aed8-6cea5aefe2c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:07.675998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:07.676820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:07.677194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:07.677560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:07.806022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:07.807612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:07.833772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1277/2564] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:12.694849 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:12.706684 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f31804-7d56-4c73-8dad-783c741f4011 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:12.710890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:12.711560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:12.711834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:12.712102 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:12.797289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:12.799036 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:12.816663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1288/2565] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:13.997012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:14.010609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=100 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:14.121444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a297e57-32c5-4c8f-823f-3b4614127b4a service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:14.127631 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:14.129953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:14.130642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:14.131142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:14.136232 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:14.261369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:14.263330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:14.283660 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1278/2566] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:14.810232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:14.812232 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:14.858202 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e814ed01-6c6f-42ff-b2f5-e42f57b88fb0 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:14.865092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:14.866279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:14.866740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:14.867042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] PATH_INFO: `/v3/users/ebd6dd3728044282b9b5bd4bf1ffdf53` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:14.868520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebd6dd3728044282b9b5bd4bf1ffdf53)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:14.870719 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:14.909281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:14.957686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebd6dd3728044282b9b5bd4bf1ffdf53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:14.970996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebd6dd3728044282b9b5bd4bf1ffdf53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:14.987113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebd6dd3728044282b9b5bd4bf1ffdf53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:14.989032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebd6dd3728044282b9b5bd4bf1ffdf53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:14.989964 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebd6dd3728044282b9b5bd4bf1ffdf53'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.010286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1289/2567] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:14 2022] DELETE /identity/v3/users/ebd6dd3728044282b9b5bd4bf1ffdf53 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:15.518288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:15.532781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd00e5-18b2-42d3-974b-af4de33df021 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:15.604494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:15.606532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:15.660480 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:15.662274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:15.663750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:15.664563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] PATH_INFO: `/v3/projects/00e6c67a76dc44bfa013af76d6db5ee6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:15.667886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00e6c67a76dc44bfa013af76d6db5ee6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:15.671514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:15.744604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5292c5-8480-4b23-8142-85d4a960844c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:15.757012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:15.758420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:15.758921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:15.760595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] PATH_INFO: `/v3/users/65a5f51369144ab3b918210fcdd6f791` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:15.762067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a5f51369144ab3b918210fcdd6f791)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:15.764915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:15.776753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00e6c67a76dc44bfa013af76d6db5ee6', 'request_id': 'req-30671b91-f3f2-4628-828a-4ae417ca6919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.790418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00e6c67a76dc44bfa013af76d6db5ee6', 'request_id': 'req-30671b91-f3f2-4628-828a-4ae417ca6919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.793268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:15.800883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00e6c67a76dc44bfa013af76d6db5ee6', 'request_id': 'req-30671b91-f3f2-4628-828a-4ae417ca6919'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.826296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] The token cache is being invalidate because project 00e6c67a76dc44bfa013af76d6db5ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:15.827286 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.828358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.832218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1279/2568] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:15 2022] DELETE /identity/v3/projects/00e6c67a76dc44bfa013af76d6db5ee6 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:15.836010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:15.837745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:15.945078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30671b91-f3f2-4628-828a-4ae417ca6919 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:15.952755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:15.954766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:15.955148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:15.955519 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] PATH_INFO: `/v3/users/847048cb84cf43338ddc5f4637c66280` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:15.957489 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] RBAC: Authorizing `identity:delete_user(user_id=847048cb84cf43338ddc5f4637c66280)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:15.959855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a5f51369144ab3b918210fcdd6f791'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:15.961230 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:15.975738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a5f51369144ab3b918210fcdd6f791'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.003748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a5f51369144ab3b918210fcdd6f791'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.004652 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a5f51369144ab3b918210fcdd6f791'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.006138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3a19a84b-727c-4f34-a8f0-8afdb8e4c7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a5f51369144ab3b918210fcdd6f791'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.026982 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847048cb84cf43338ddc5f4637c66280'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.041154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1290/2569] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:15 2022] DELETE /identity/v3/users/65a5f51369144ab3b918210fcdd6f791 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:16.042454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847048cb84cf43338ddc5f4637c66280'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.044290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847048cb84cf43338ddc5f4637c66280'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.049063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847048cb84cf43338ddc5f4637c66280'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.053109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:16.053640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:16.054073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:16.068212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847048cb84cf43338ddc5f4637c66280'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.084159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1280/2570] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:15 2022] DELETE /identity/v3/users/847048cb84cf43338ddc5f4637c66280 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:16.106947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:16.108951 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:16.169988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:16.260225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1291/2571] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:16.274815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:16.276360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:16.377816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad493c1-3040-45e7-91de-08e62070804a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:16.382236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:16.383259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:16.383614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:16.383958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:16.399761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:16.402670 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:16.415658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1281/2572] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:16.486764 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:16.488374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:16.512589 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e5b14-cbb2-4498-a1aa-335ccd6ce733 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:16.524238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:16.525288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:16.525624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:16.526311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] PATH_INFO: `/v3/projects/62c2fa80a8664c49a73edf79886f94a8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:16.531725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c2fa80a8664c49a73edf79886f94a8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:16.534120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:16.625446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c2fa80a8664c49a73edf79886f94a8', 'request_id': 'req-e0af4754-eb64-4851-8fb5-41ce81b1c874'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.633548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c2fa80a8664c49a73edf79886f94a8', 'request_id': 'req-e0af4754-eb64-4851-8fb5-41ce81b1c874'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.646845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c2fa80a8664c49a73edf79886f94a8', 'request_id': 'req-e0af4754-eb64-4851-8fb5-41ce81b1c874'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.679065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] The token cache is being invalidate because project 62c2fa80a8664c49a73edf79886f94a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:16.682950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.698114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:16.701308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1292/2573] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:16 2022] DELETE /identity/v3/projects/62c2fa80a8664c49a73edf79886f94a8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:16.888335 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:16.888897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:16.929246 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81b16f-1285-4790-8fed-2f010f11f719 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:16.941481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:17.056731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:17.058462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:17.058739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:17.059007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] PATH_INFO: `/v3/projects/26be1b19466d4e00b0e4818164c256a8` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:17.060463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=26be1b19466d4e00b0e4818164c256a8)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:17.062380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:17.158973 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26be1b19466d4e00b0e4818164c256a8', 'request_id': 'req-9d21e190-d653-4014-9115-4032cd1c84bf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.177807 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26be1b19466d4e00b0e4818164c256a8', 'request_id': 'req-9d21e190-d653-4014-9115-4032cd1c84bf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.189606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26be1b19466d4e00b0e4818164c256a8', 'request_id': 'req-9d21e190-d653-4014-9115-4032cd1c84bf'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.211598 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] The token cache is being invalidate because project 26be1b19466d4e00b0e4818164c256a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:17.211847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.214479 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.219422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1282/2574] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:16 2022] DELETE /identity/v3/projects/26be1b19466d4e00b0e4818164c256a8 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:17.223834 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:17.225568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:17.247776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af4754-eb64-4851-8fb5-41ce81b1c874 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:17.350041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:17.351038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:17.351428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:17.351779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] PATH_INFO: `/v3/users/96092f8bdca443d3a61b9c5f7c13fc39` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:17.353181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96092f8bdca443d3a61b9c5f7c13fc39)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:17.355242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:17.420887 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96092f8bdca443d3a61b9c5f7c13fc39'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.425908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:17.437493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96092f8bdca443d3a61b9c5f7c13fc39'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.458885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96092f8bdca443d3a61b9c5f7c13fc39'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.459857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96092f8bdca443d3a61b9c5f7c13fc39'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.461278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96092f8bdca443d3a61b9c5f7c13fc39'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:17.483942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1293/2575] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:17 2022] DELETE /identity/v3/users/96092f8bdca443d3a61b9c5f7c13fc39 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:18.048464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:18.049925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:18.086430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21e190-d653-4014-9115-4032cd1c84bf admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:18.238071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:18.239072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:18.239422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:18.239767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] PATH_INFO: `/v3/projects/902e7ed2410d49cc965064dd4adcf1ca` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:18.242156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=902e7ed2410d49cc965064dd4adcf1ca)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:18.244884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:18.377034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:18.395266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '902e7ed2410d49cc965064dd4adcf1ca', 'request_id': 'req-0ad13347-a208-46fe-b759-f3cf32e12c72'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.410965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '902e7ed2410d49cc965064dd4adcf1ca', 'request_id': 'req-0ad13347-a208-46fe-b759-f3cf32e12c72'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.433578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '902e7ed2410d49cc965064dd4adcf1ca', 'request_id': 'req-0ad13347-a208-46fe-b759-f3cf32e12c72'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.472666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] The token cache is being invalidate because project 902e7ed2410d49cc965064dd4adcf1ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:18.474190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.476249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.479496 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1283/2576] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:18 2022] DELETE /identity/v3/projects/902e7ed2410d49cc965064dd4adcf1ca => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:18.483840 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:18.485848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:18.525528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4123f9d-66d2-46c6-83fe-8af6d90d2bc2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:18.627827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:18.628690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:18.628968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:18.629240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] PATH_INFO: `/v3/users/3ec2bdb00f73471f820f7eaf0e003c56` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:18.630712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec2bdb00f73471f820f7eaf0e003c56)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:18.633142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:18.721213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec2bdb00f73471f820f7eaf0e003c56'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.732383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec2bdb00f73471f820f7eaf0e003c56'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.749499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec2bdb00f73471f820f7eaf0e003c56'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.750286 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec2bdb00f73471f820f7eaf0e003c56'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.750980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec2bdb00f73471f820f7eaf0e003c56'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:18.786561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1294/2577] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:18 2022] DELETE /identity/v3/users/3ec2bdb00f73471f820f7eaf0e003c56 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:18.786855 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:18.788432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:18.812624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad13347-a208-46fe-b759-f3cf32e12c72 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:18.901020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:18.901811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:18.902128 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:18.902890 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] PATH_INFO: `/v3/users/ca817816906a46a9a2423dc427fa3cee` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:18.919135 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca817816906a46a9a2423dc427fa3cee)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:18.921392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:18.991752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca817816906a46a9a2423dc427fa3cee'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.003085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca817816906a46a9a2423dc427fa3cee'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.004094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca817816906a46a9a2423dc427fa3cee'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.004943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca817816906a46a9a2423dc427fa3cee'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.023365 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca817816906a46a9a2423dc427fa3cee'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.039695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1284/2578] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:18 2022] DELETE /identity/v3/users/ca817816906a46a9a2423dc427fa3cee => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:19.118511 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.120641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.135000 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112eb56-f9b6-475b-9401-8242a4d75c1e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.211388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:19.230359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.231264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.231717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.231988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] PATH_INFO: `/v3/projects/928538d2e06046f495e52f50b1ee6095` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.233816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928538d2e06046f495e52f50b1ee6095)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.236270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.340144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.341745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.350140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928538d2e06046f495e52f50b1ee6095', 'request_id': 'req-b85968cf-85e4-4093-9c1a-bd739a52d567'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.364713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35805c-6d16-484d-b794-c997640b1d9f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.374578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928538d2e06046f495e52f50b1ee6095', 'request_id': 'req-b85968cf-85e4-4093-9c1a-bd739a52d567'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.390593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928538d2e06046f495e52f50b1ee6095', 'request_id': 'req-b85968cf-85e4-4093-9c1a-bd739a52d567'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.404200 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] The token cache is being invalidate because project 928538d2e06046f495e52f50b1ee6095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:19.404782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.405578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b85968cf-85e4-4093-9c1a-bd739a52d567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.407555 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1295/2579] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:19 2022] DELETE /identity/v3/projects/928538d2e06046f495e52f50b1ee6095 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:19.414038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd5f-9a38-40ba-a6f6-7cb8be2cca04 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.414326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd5f-9a38-40ba-a6f6-7cb8be2cca04 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.414598 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7cd5f-9a38-40ba-a6f6-7cb8be2cca04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.426005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:19.472614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.473715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.474145 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.474579 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] PATH_INFO: `/v3/projects/f845e08d872246e7941be676801f7722` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.480435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a0f7cd5f-9a38-40ba-a6f6-7cb8be2cca04 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:19.481660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a0f7cd5f-9a38-40ba-a6f6-7cb8be2cca04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.488169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f845e08d872246e7941be676801f7722)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.490674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.505929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1296/2580] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:19.510668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.511231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.512204 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.534923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:19.536451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.552182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f845e08d872246e7941be676801f7722', 'request_id': 'req-db8e3c31-986b-43fd-a16d-ea103f3c989f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.564764 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f845e08d872246e7941be676801f7722', 'request_id': 'req-db8e3c31-986b-43fd-a16d-ea103f3c989f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.578846 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f845e08d872246e7941be676801f7722', 'request_id': 'req-db8e3c31-986b-43fd-a16d-ea103f3c989f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.592950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] The token cache is being invalidate because project f845e08d872246e7941be676801f7722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:19.593259 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.594580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-db8e3c31-986b-43fd-a16d-ea103f3c989f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:19.596189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1285/2581] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:19 2022] DELETE /identity/v3/projects/f845e08d872246e7941be676801f7722 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:19.602318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae2c5-55b1-442b-9ab8-793276de8132 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.602740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae2c5-55b1-442b-9ab8-793276de8132 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.603244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae2c5-55b1-442b-9ab8-793276de8132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.611788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1297/2582] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:19.615654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.627582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e63ae2c5-55b1-442b-9ab8-793276de8132 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:19.628869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e63ae2c5-55b1-442b-9ab8-793276de8132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.632744 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686d921f-89df-4f62-a263-25f32f18f4e1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.637663 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1286/2583] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:19.642294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.642979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.643252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.643522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.644437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:19.644867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.646508 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.646717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.647219 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.647671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.660677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1298/2584] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:19.666884 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.678019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:19.678522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a15de-3f91-4516-b28a-801494bef69a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.679824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:19.685541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.686517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.686868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.687260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.688024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.690148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.692946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1287/2585] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:19.696837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.710460 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef270c-faf8-473e-94f2-060ad6ceb907 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.717302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.718500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.719181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.719721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.720735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:19.721294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.723386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.728761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1299/2586] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:19.731458 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.740559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1288/2587] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:15:19.744231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.755987 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83bfe06-43a4-4af8-9906-8dd7eacbb2a8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.782209 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:19.818729 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c767a03-659a-4777-adf5-72108b3499d3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.824793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.825702 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.826003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.826308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.826954 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.829154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.860105 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1300/2588] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:19.861217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.861466 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.862150 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.864348 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.864767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.865738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.868659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.877359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe767858-0f88-461e-9dae-2307e0475208 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.884546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:19.885868 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:19.887596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:19.887596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:19.887596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:19.889326 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:19.904991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1301/2589] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:19.909827 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.918241 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1289/2590] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:19.919521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:19.930225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e258c-179f-412a-b330-518ca1ccf1b2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:19.953304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:20.011500 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ff86c4-f913-4ec0-b662-c71b6abe6721 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.016299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.016991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.017401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.017684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.018452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.021160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.022268 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.023370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.023861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.024504 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.025453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.027273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.048774 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1302/2591] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:20.050260 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1290/2592] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:19 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:20.050712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.051238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.066354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc67ab-5956-43b7-8d53-e54136cd9b35 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.073721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.075018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.075777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.076284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.078575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.080687 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.093748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac75bf-8c0b-4cef-9fc7-3b528207c754 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.099399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1291/2593] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:20.103965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.104847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.105881 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.106223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.106629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] PATH_INFO: `/v3/projects/c73764c75fc345e9aa91d0df70c855aa/users/776612aa58264b008504f5c7103d7880/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.114972 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241f4e5-d576-4b20-82eb-df639519731b admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.124667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.125491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.125776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.126002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73764c75fc345e9aa91d0df70c855aa, user_id=776612aa58264b008504f5c7103d7880, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.126115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.126824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.128736 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.128930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b867d8-c772-4ec0-aab8-aa5e601b03f4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.141787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1292/2594] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:20.145611 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.161135 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1303/2595] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/c73764c75fc345e9aa91d0df70c855aa/users/776612aa58264b008504f5c7103d7880/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:20.161354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd2698-259f-4bf5-9671-50b7837ab400 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.163962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.164305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.164599 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.203958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] MFA Rules not processed for user `776612aa58264b008504f5c7103d7880`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:20.205502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:20.238406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.239379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.239690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.239957 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] PATH_INFO: `/v3/projects/5e3903fed65f40cdbf0fa7b22a8d3208/users/6dfd68c8de8c4a1d813d967c88b76012/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.258521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e3903fed65f40cdbf0fa7b22a8d3208, user_id=6dfd68c8de8c4a1d813d967c88b76012, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.262194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c095817-59ef-4bee-87c8-2f88f20f6fec admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.282066 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1293/2596] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/5e3903fed65f40cdbf0fa7b22a8d3208/users/6dfd68c8de8c4a1d813d967c88b76012/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:20.294501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.294898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.295380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.299120 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1304/2597] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:20.303510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.316342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba24253-d0cd-4526-adb8-aa9821592472 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.331746 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:20.332886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] MFA Rules not processed for user `6dfd68c8de8c4a1d813d967c88b76012`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:20.334277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:20.394276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.395093 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.395510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.395905 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.396790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.399338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.409580 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:20.416983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1294/2598] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:20.421656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.433303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1305/2599] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:20.437241 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.442415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f2bf7-a337-404a-9e62-3a05fe912dde None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.517098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03189bca-58f4-4525-889b-c910ac35d1cd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.522753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.523860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.523998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.524521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.524720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.524988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.525086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.525266 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.525951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.526152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.528674 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.528812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.558841 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1295/2600] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:20.562309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.564370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1306/2601] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:20.567878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.580929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d453c87-6235-469c-8b95-c19e46f55318 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.646989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56de24-a493-40ba-bd3c-41f9b9e26254 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.653247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.654545 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.655075 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.655636 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.657003 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.660012 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.665708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.666393 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.666668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.666936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.667690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.669507 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.688194 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1307/2602] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:20.690540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.694027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1296/2603] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:20.698658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.707568 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0db289-dbf1-455d-ae70-9707488994ac admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.711019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef0b9e-8477-4ac4-918e-649c2f26aaa7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.716249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.716895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.717243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.717429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.718162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.718807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.719797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.721071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.723691 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.724186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] PATH_INFO: `/v3/projects/9a5eff4391944083b65b879bfd82412b/users/988b50efb43843f89df89d6427bc9931/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.732189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1297/2604] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:20.735515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.743061 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5eff4391944083b65b879bfd82412b, user_id=988b50efb43843f89df89d6427bc9931, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.746230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.747229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930c7c4-d266-414a-b996-f8962ebbf02a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.753238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.754345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.754628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.754900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] PATH_INFO: `/v3/projects/2ee4d363370849fa88bcd6793208451b/users/3258cec747914a3bb7624f513d4ef970/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.765978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1308/2605] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/9a5eff4391944083b65b879bfd82412b/users/988b50efb43843f89df89d6427bc9931/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:20.772035 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.779563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee4d363370849fa88bcd6793208451b, user_id=3258cec747914a3bb7624f513d4ef970, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.780808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:20.782351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.807607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1298/2606] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/2ee4d363370849fa88bcd6793208451b/users/3258cec747914a3bb7624f513d4ef970/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:20.812551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.867140 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af062-b3d5-44bc-bdc7-5fe35a42746f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.868178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:20.894462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6834f00-cfbc-4d87-9e86-6e645458ed5f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.900081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.900787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.901061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.901334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.904371 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.906264 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.920410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1299/2607] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:20.922754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.938132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda38cc-2d96-4b4d-9798-c71f85e8598a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:20.943356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.944304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.944652 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.944854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] PATH_INFO: `/v3/projects/2ee4d363370849fa88bcd6793208451b/users/3258cec747914a3bb7624f513d4ef970/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.946995 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ee4d363370849fa88bcd6793208451b, user_id=3258cec747914a3bb7624f513d4ef970, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.949858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db545c-cb2c-49c2-b475-666b13b38c94 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.959523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:20.960595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.960979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.961340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.962309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:20.963649 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1300/2608] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/2ee4d363370849fa88bcd6793208451b/users/3258cec747914a3bb7624f513d4ef970/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:20.963857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:20.976282 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1309/2609] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:20.976482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:20.976482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:20.976482 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:20.979033 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:20.990226 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf79c9-988b-4772-986a-64a687ee3e69 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:21.014723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] MFA Rules not processed for user `3258cec747914a3bb7624f513d4ef970`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:21.016456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:21.054813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:21.055736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.056145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.056318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] PATH_INFO: `/v3/projects/9a5eff4391944083b65b879bfd82412b/users/988b50efb43843f89df89d6427bc9931/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.058489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a5eff4391944083b65b879bfd82412b, user_id=988b50efb43843f89df89d6427bc9931, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:21.061322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c3695-2c5c-408a-b3ce-952aa26dad91 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:21.079712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1310/2610] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:20 2022] PUT /identity/v3/projects/9a5eff4391944083b65b879bfd82412b/users/988b50efb43843f89df89d6427bc9931/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:21.086259 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.086550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.086830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.119669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] MFA Rules not processed for user `988b50efb43843f89df89d6427bc9931`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:21.121522 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:21.127078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1301/2611] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:21.137375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:21.141364 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:21.161670 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:21.216914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1311/2612] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:21.231457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:21.234239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:21.247524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3cf93-20b1-4d96-b96d-c3aa0e9e7278 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:21.320026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:21.321040 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.321445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.321875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.328952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03718-b6f7-4800-a6d7-9cc35d7c49f5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:21.335218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:21.336643 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.337387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.338078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.340716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:21.353645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:21.355519 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:21.372739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1312/2613] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:21.408640 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:21.410329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:21.424296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1302/2614] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:21.523248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:21.534084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821b2e9-fa96-45dc-b85a-d0f83c973e96 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:21.536969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:21.538503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:21.539328 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.539708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.540078 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.553027 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c049ba1-5825-4e41-a69a-cc461e910fa5 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:21.563396 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:21.564253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:21.564760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:21.565156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:21.616935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:21.618478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:21.630923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1313/2615] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:21.662081 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:21.663847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729447b-1cf0-43f1-8ef0-b36f269f4d53 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:21.674505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1303/2616] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:24.396270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:24.476975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f6165-3eb1-4680-b3b7-f41fd324f454 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:24.481742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:24.482641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:24.482919 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:24.483191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] PATH_INFO: `/v3/users/776612aa58264b008504f5c7103d7880` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:24.484430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=776612aa58264b008504f5c7103d7880)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:24.486359 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:24.494801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:24.553270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776612aa58264b008504f5c7103d7880'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:24.564348 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776612aa58264b008504f5c7103d7880'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:24.584469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776612aa58264b008504f5c7103d7880'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:24.588794 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776612aa58264b008504f5c7103d7880'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:24.589706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776612aa58264b008504f5c7103d7880'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:24.609576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1314/2617] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:24 2022] DELETE /identity/v3/users/776612aa58264b008504f5c7103d7880 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:24.614415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:24.614926 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:24.615020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:24.640946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:24.642210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:24.739315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1304/2618] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:24.750208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:24.751730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:24.820825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c49d99-1e87-4c76-9e37-c6b6e84503a8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:24.825718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:24.826628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:24.827130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:24.827491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:24.838462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:24.840075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:24.851585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1315/2619] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:25.148342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:25.150425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:25.185418 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2bac9-4d05-45e8-ade6-9241fa0cfc46 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:25.191311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:25.192525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:25.192998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:25.193369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] PATH_INFO: `/v3/projects/c73764c75fc345e9aa91d0df70c855aa` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:25.194692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73764c75fc345e9aa91d0df70c855aa)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:25.196882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:25.253202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:25.256374 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73764c75fc345e9aa91d0df70c855aa', 'request_id': 'req-3ca1ac43-ed16-4d31-937b-9743abe227d1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.272385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73764c75fc345e9aa91d0df70c855aa', 'request_id': 'req-3ca1ac43-ed16-4d31-937b-9743abe227d1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.280160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73764c75fc345e9aa91d0df70c855aa', 'request_id': 'req-3ca1ac43-ed16-4d31-937b-9743abe227d1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.293961 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] The token cache is being invalidate because project c73764c75fc345e9aa91d0df70c855aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:25.294277 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.294896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.296924 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1305/2620] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:25 2022] DELETE /identity/v3/projects/c73764c75fc345e9aa91d0df70c855aa => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:25.300839 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:25.311607 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c549ce-1f66-430d-9473-57d975be872c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:25.385398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:25.386440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:25.386793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:25.387128 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] PATH_INFO: `/v3/users/988b50efb43843f89df89d6427bc9931` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:25.389358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988b50efb43843f89df89d6427bc9931)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:25.391405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:25.432604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:25.452658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988b50efb43843f89df89d6427bc9931'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.465039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988b50efb43843f89df89d6427bc9931'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.481211 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988b50efb43843f89df89d6427bc9931'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.482104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988b50efb43843f89df89d6427bc9931'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.482708 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-d22d2f3c-ed4f-4d7b-8a73-3950ce8081a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988b50efb43843f89df89d6427bc9931'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:25.497930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1316/2621] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:25 2022] DELETE /identity/v3/users/988b50efb43843f89df89d6427bc9931 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:25.874038 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:25.876112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:25.890820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ac43-ed16-4d31-937b-9743abe227d1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:25.965247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:25.966584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:25.966584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:25.966850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] PATH_INFO: `/v3/projects/9a5eff4391944083b65b879bfd82412b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:25.968148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a5eff4391944083b65b879bfd82412b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:25.970304 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.025042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a5eff4391944083b65b879bfd82412b', 'request_id': 'req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:26.038274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a5eff4391944083b65b879bfd82412b', 'request_id': 'req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:26.052694 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a5eff4391944083b65b879bfd82412b', 'request_id': 'req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:26.072698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] The token cache is being invalidate because project 9a5eff4391944083b65b879bfd82412b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:26.073102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:26.073793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2ffdfb94-6df1-4f9b-a08c-a1bfe1dc7d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:26.076162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1306/2622] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:25 2022] DELETE /identity/v3/projects/9a5eff4391944083b65b879bfd82412b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:26.080756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.080976 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.081248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.102188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:26.103525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:26.178043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1317/2623] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:26.187338 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.187873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.188271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.212337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:26.213872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:26.226900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1307/2624] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:26.231397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.242970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215221c9-86b4-4ec6-9861-90ccb35b0896 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.262957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.263836 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.264474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.264665 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.265482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:26.265854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.267645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.287978 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1318/2625] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:15:26.292316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.306096 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c989ce-e3bb-4f54-b0db-568b32c644c1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.311487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.312302 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.312603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.312861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.313655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.315907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.347472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1308/2626] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:26.351362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.362435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc810fe-d216-4b2e-aa8b-72f8b3411fa6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.440356 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.441477 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.441814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.442451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.444612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.448878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.482048 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1319/2627] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:26.486000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.518607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ec359-abd1-42b8-8165-7636129a0083 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.518858 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.519512 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.519789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.520061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.520847 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.522487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.537695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1309/2628] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:26.539308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.552372 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53182958-7039-44dd-9ce1-e432938fc5a3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.557651 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.558083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.558364 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.558639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.559380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.561152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8bc07d-1c93-4ae9-ab81-3a03ee98ca5d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.575983 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1320/2629] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:26.579802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.592941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9613f-b031-4747-9f20-24184420df7e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.598426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.599517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.599902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.600309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] PATH_INFO: `/v3/projects/c4c8bac47f864272b21dc9c1ca85db89/users/7bd7aaf1406c44688e8993af33fc35a4/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.621909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4c8bac47f864272b21dc9c1ca85db89, user_id=7bd7aaf1406c44688e8993af33fc35a4, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.624637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.634856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:26.641412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1310/2630] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:26 2022] PUT /identity/v3/projects/c4c8bac47f864272b21dc9c1ca85db89/users/7bd7aaf1406c44688e8993af33fc35a4/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:26.654248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.654528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.654796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.680863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:26.686475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] MFA Rules not processed for user `7bd7aaf1406c44688e8993af33fc35a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:26.688654 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:26.762768 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1321/2631] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:26.767428 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.834325 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52acc1-7be3-441f-92e9-6163487e48db admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.839423 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.840063 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.840380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.840690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.841400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.843373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.874254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1311/2632] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:26.875321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.886492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ab29c-3d68-44c2-8d07-8afcf32ce2a1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.948251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.948938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.949213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.949481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.950502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.952486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:26.977415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1322/2633] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:26 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:26.978756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:26.989629 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c6c0a7-0cc4-46b4-b016-9a03a9f95c6f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:26.995793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:26.996513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:26.996785 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:26.997051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:26.997791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:26.999393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.010201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1312/2634] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:27.014413 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.025221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974eec61-21f6-4611-89ea-11559e7c962b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.031150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.032043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.032366 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.032628 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] PATH_INFO: `/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a/users/d8a86b50be664960bf1def296864576f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.049136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b87eb2c3bd4a6681e7eac4b716c89a, user_id=d8a86b50be664960bf1def296864576f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.051776 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.066830 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1323/2635] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:27 2022] PUT /identity/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a/users/d8a86b50be664960bf1def296864576f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:27.070989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.082289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52871-1dcf-4374-b97d-b1d6885949fc admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.148654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.149249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.149508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.149772 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.150528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.152193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be85986-244c-496f-a791-e29611c126cb admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.162673 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1313/2636] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:27 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:27.167107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.178150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95becf-0092-4b4d-86b1-ee520082d2de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.184819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.185707 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.185984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.186243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] PATH_INFO: `/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a/users/d8a86b50be664960bf1def296864576f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.188456 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7b87eb2c3bd4a6681e7eac4b716c89a, user_id=d8a86b50be664960bf1def296864576f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.191083 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.202404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1324/2637] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:27 2022] PUT /identity/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a/users/d8a86b50be664960bf1def296864576f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:27.212911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661806-e5e7-43e6-9424-c81eae7d83f8 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.213195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661806-e5e7-43e6-9424-c81eae7d83f8 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.213464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84661806-e5e7-43e6-9424-c81eae7d83f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.241090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-84661806-e5e7-43e6-9424-c81eae7d83f8 None None] MFA Rules not processed for user `d8a86b50be664960bf1def296864576f`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:27.242444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-84661806-e5e7-43e6-9424-c81eae7d83f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:27.311170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:27.324810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1314/2638] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:27.336412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.345861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:27.396714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.396996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.397276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.408731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55db19f-4717-4419-b02b-fd9751c4dff7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.412780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.413455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.413787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.414062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.416507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:27.417765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:27.423726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.425205 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.429134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:27.436412 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1325/2639] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:27.476344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1315/2640] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:27.489015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.490650 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:27.517662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.527229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd4380-c39b-4efd-9840-b6e64858f819 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.530767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.531411 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.531686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.531958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.564050 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec52ace-e714-46d3-9557-9bd166debf17 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.569307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.570121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:27.570461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:27.570815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:27.579384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.581020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.588952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1326/2641] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:27.592678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:27.594491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110657d-38f6-4cfb-bee9-c2aed527ed8a service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:27.604175 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1316/2642] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:27.915494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:27.993928 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556f3ea-6447-4b1b-a33d-c86fafd8a26b service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:27.998741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:27.999624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:28.000159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:28.000437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] PATH_INFO: `/v3/users/7bd7aaf1406c44688e8993af33fc35a4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:28.001799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bd7aaf1406c44688e8993af33fc35a4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:28.003987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:28.058155 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bd7aaf1406c44688e8993af33fc35a4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.068073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bd7aaf1406c44688e8993af33fc35a4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.080548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bd7aaf1406c44688e8993af33fc35a4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.081183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bd7aaf1406c44688e8993af33fc35a4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.081783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bd7aaf1406c44688e8993af33fc35a4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.094426 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1327/2643] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:27 2022] DELETE /identity/v3/users/7bd7aaf1406c44688e8993af33fc35a4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:28.099290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:28.099777 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:28.100026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:28.117851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:28.119051 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:28.180589 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1317/2644] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:28.190355 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:28.192058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:28.202811 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:28.256624 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95391c-a61e-4511-adb8-86897289165f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:28.260358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:28.261012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:28.261288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:28.261579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:28.272371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:28.273904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:28.283498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1328/2645] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:28.576281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:28.577734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:28.591342 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d267704-11f2-4c96-80b0-8140991a1251 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:28.596708 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:28.597685 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:28.597991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:28.598288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] PATH_INFO: `/v3/projects/c4c8bac47f864272b21dc9c1ca85db89` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:28.600004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4c8bac47f864272b21dc9c1ca85db89)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:28.602076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:28.642377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:28.653417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4c8bac47f864272b21dc9c1ca85db89', 'request_id': 'req-0d65a834-7634-40d7-a8a3-4f78e0300712'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.661881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4c8bac47f864272b21dc9c1ca85db89', 'request_id': 'req-0d65a834-7634-40d7-a8a3-4f78e0300712'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.670607 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4c8bac47f864272b21dc9c1ca85db89', 'request_id': 'req-0d65a834-7634-40d7-a8a3-4f78e0300712'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.683174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] The token cache is being invalidate because project c4c8bac47f864272b21dc9c1ca85db89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:28.683398 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.684244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.685971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1318/2646] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:28 2022] DELETE /identity/v3/projects/c4c8bac47f864272b21dc9c1ca85db89 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:28.690175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:28.699984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ebeaa-6b71-4dd3-880e-c9660c235467 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:28.761065 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:28.761947 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:28.762223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:28.762491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] PATH_INFO: `/v3/users/d8a86b50be664960bf1def296864576f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:28.763714 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8a86b50be664960bf1def296864576f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:28.765686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:28.815185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8a86b50be664960bf1def296864576f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.822892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8a86b50be664960bf1def296864576f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.834853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8a86b50be664960bf1def296864576f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.835553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8a86b50be664960bf1def296864576f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.836186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-abe48569-4aef-4744-9e4e-b1eca52b8197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8a86b50be664960bf1def296864576f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:28.848808 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1329/2647] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:28 2022] DELETE /identity/v3/users/d8a86b50be664960bf1def296864576f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:29.200086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.202896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:29.218729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65a834-7634-40d7-a8a3-4f78e0300712 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.315888 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.317065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.317522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.317903 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] PATH_INFO: `/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.319225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7b87eb2c3bd4a6681e7eac4b716c89a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.322442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.376788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7b87eb2c3bd4a6681e7eac4b716c89a', 'request_id': 'req-5d893f5f-0fb0-4d42-82b8-e6249435e370'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.385111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7b87eb2c3bd4a6681e7eac4b716c89a', 'request_id': 'req-5d893f5f-0fb0-4d42-82b8-e6249435e370'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.391659 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7b87eb2c3bd4a6681e7eac4b716c89a', 'request_id': 'req-5d893f5f-0fb0-4d42-82b8-e6249435e370'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.403830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] The token cache is being invalidate because project f7b87eb2c3bd4a6681e7eac4b716c89a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:29.404112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.404804 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5d893f5f-0fb0-4d42-82b8-e6249435e370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.406426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1319/2648] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:29 2022] DELETE /identity/v3/projects/f7b87eb2c3bd4a6681e7eac4b716c89a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:29.411305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.411618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.411885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.434227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:29.435450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:29.461560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:29.499986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1330/2649] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:29.508974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.509463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.509971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.531875 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:29.533172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:29.543054 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1320/2650] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:29.547394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.558031 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21218b-1dbc-4bc0-b405-d9763c0973c9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.563475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.564389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.564518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.564696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.565736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:29.566075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.567880 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.585653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1331/2651] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:29.587391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.598258 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e59baad-a209-449d-8255-9a6398f44627 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.604551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.605312 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.605633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.606017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.606962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.609010 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.638552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1321/2652] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:29 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:29.643081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.655478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c06413-aa5e-4305-b774-4c76ef69ee24 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.660658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.662508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:29.697333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:29.725469 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.726137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.726415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.726685 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.727446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.729418 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.739111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260b0e2-cd19-40c0-b997-0f4a0d8e39f3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.744760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.745900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.746372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.746507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] PATH_INFO: `/v3/users/be7ebec8d17f4b8d88197ce47169e4ef` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.747602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7ebec8d17f4b8d88197ce47169e4ef)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.749549 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.754344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1332/2653] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:29 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:29.756063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.766398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67291f4f-4f87-4499-b7ec-9f89f1661e0d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.772390 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.773177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.773454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.773717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.774443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.776298 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.788184 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1333/2654] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:29.791986 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.801865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde86bf-964b-4dcb-907c-37a3b4bf2c9c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.804305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7ebec8d17f4b8d88197ce47169e4ef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.807613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.808370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.808675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.809049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.810183 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.812178 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.813918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7ebec8d17f4b8d88197ce47169e4ef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.814710 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7ebec8d17f4b8d88197ce47169e4ef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.815327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7ebec8d17f4b8d88197ce47169e4ef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.826582 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1334/2655] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:29.828076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4dd3b1d4-1f0b-40a4-bce3-1d03d7b05ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7ebec8d17f4b8d88197ce47169e4ef'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:29.830509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:29.832188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:29.840425 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1322/2656] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:29 2022] DELETE /identity/v3/users/be7ebec8d17f4b8d88197ce47169e4ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:29.844724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49158bf-759c-4693-9d43-2e529f18014d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:29.901266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:29.902174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.902453 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.902730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] PATH_INFO: `/v3/projects/4126a6ee4d094ace8083ca61289136f5/users/d9c9f9ca989a4d43903a6233a8828cfb/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.917591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4126a6ee4d094ace8083ca61289136f5, user_id=d9c9f9ca989a4d43903a6233a8828cfb, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:29.920297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:29.935612 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1335/2657] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:29 2022] PUT /identity/v3/projects/4126a6ee4d094ace8083ca61289136f5/users/d9c9f9ca989a4d43903a6233a8828cfb/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:29.947184 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:29.947477 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:29.948323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:29.975469 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] MFA Rules not processed for user `d9c9f9ca989a4d43903a6233a8828cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:29.976796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.016239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.018002 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.027876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.051430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1323/2658] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:30.052372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.086353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.091089 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5e4bb-19b4-4151-b3eb-c38ab00c8717 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.097272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.098163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.098444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.098718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] PATH_INFO: `/v3/projects/db6ba823411041e6be5e26b11e06eb56` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.100010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6ba823411041e6be5e26b11e06eb56)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.102067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.118501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091620-4473-4d34-b2e2-6a06af10b2ea None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.123033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.123715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.124043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.124350 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.125053 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.126976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.149319 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6ba823411041e6be5e26b11e06eb56', 'request_id': 'req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:30.154613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1324/2659] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:30.155753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6ba823411041e6be5e26b11e06eb56', 'request_id': 'req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:30.158802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.164786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6ba823411041e6be5e26b11e06eb56', 'request_id': 'req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:30.176966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] The token cache is being invalidate because project db6ba823411041e6be5e26b11e06eb56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:30.177252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:30.177901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8ba54062-9682-4b9f-af7f-bbdf8b4f34de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:30.179516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1336/2660] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:30 2022] DELETE /identity/v3/projects/db6ba823411041e6be5e26b11e06eb56 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:30.184244 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036186-11fa-40e5-9f9a-c595ca0b35b7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.184529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036186-11fa-40e5-9f9a-c595ca0b35b7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.184800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2036186-11fa-40e5-9f9a-c595ca0b35b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.203303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a2036186-11fa-40e5-9f9a-c595ca0b35b7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:30.204736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a2036186-11fa-40e5-9f9a-c595ca0b35b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.223743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb8cb29-c886-4915-be10-64ed8c8b69c6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.228380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.228988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.229261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.229525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.230207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.232159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.255967 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1325/2661] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:30.257077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.258810 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.262853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1337/2662] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:30.270297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.270590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.270703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc192b0-8bdc-46d5-99e2-9cc95e81f326 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.270873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.275305 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.275965 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.276282 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.276561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.277294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.278886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.289087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1326/2663] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:30.289770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:30.290982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.293106 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.299716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1338/2664] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:30.303299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.303432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc277de-5bad-4fd8-af6b-e3c553cc20b3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.308086 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.309022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.309333 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.309613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] PATH_INFO: `/v3/projects/f895199466f549db87d12d25ba2b1dfe/users/2b7b30954e3b45748728dff181750e82/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.312535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5f44e6-64d7-4210-92c7-c071d4fd305a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.319573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.320436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.320686 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.320957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.321740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:30.322051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.323900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.327091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f895199466f549db87d12d25ba2b1dfe, user_id=2b7b30954e3b45748728dff181750e82, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.329794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.335929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1339/2665] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:15:30.340543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.343586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1327/2666] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:30 2022] PUT /identity/v3/projects/f895199466f549db87d12d25ba2b1dfe/users/2b7b30954e3b45748728dff181750e82/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:30.348105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.352813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c972d-def6-4ef2-ba3f-fc9f004016a1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.368247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.421343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cba310-cf99-40a6-9391-fbfa01c2f1d1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.422587 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.423258 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.423534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.423812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.424640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.426527 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.426649 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.427196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.429573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.429573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.429573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.430156 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.443453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1328/2667] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:30.446817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.459515 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f015f0-113f-4a0f-b3d6-7a0db7dd4f44 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.460505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1340/2668] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:30.464350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.465622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.530260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52460376-4e13-4a4b-a5bf-430411a6588c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.531830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.532768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.533043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.533314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] PATH_INFO: `/v3/projects/f895199466f549db87d12d25ba2b1dfe/users/2b7b30954e3b45748728dff181750e82/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.535284 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.535642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f895199466f549db87d12d25ba2b1dfe, user_id=2b7b30954e3b45748728dff181750e82, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.536111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.536472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.536803 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.537559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.539082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb471d57-4bc4-410d-aebd-4d9f897977cd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.539709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.553082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1329/2669] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:30 2022] PUT /identity/v3/projects/f895199466f549db87d12d25ba2b1dfe/users/2b7b30954e3b45748728dff181750e82/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:30.563016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1341/2670] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:30.564337 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.565092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.565433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.565662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.575740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc91a3-b280-4c22-b8ca-e0308b051678 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.595684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] MFA Rules not processed for user `2b7b30954e3b45748728dff181750e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:30.596966 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.651605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.652343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.652626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.653003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.653787 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.655533 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.668449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1342/2671] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:30.670588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.685055 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290db37b-b699-4036-8c4b-65865c32b271 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.688709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1330/2672] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:30.691101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.691948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.692303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.692581 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.693526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.695283 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.701377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.702763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.706304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1343/2673] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:30.710472 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.721461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b4b0d-4275-40f7-8719-3c1a8cc4895f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.726370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.727256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.727536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.727818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] PATH_INFO: `/v3/projects/a648f56261ed48709e60287fb0957ce6/users/a08911ab0b8546ecba185aa3df2b7b30/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.742930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a648f56261ed48709e60287fb0957ce6, user_id=a08911ab0b8546ecba185aa3df2b7b30, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.745545 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5eb72-4f6e-409d-a9a1-5ebbc7934ac2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.747924 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.761285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1344/2674] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:30 2022] PUT /identity/v3/projects/a648f56261ed48709e60287fb0957ce6/users/a08911ab0b8546ecba185aa3df2b7b30/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:30.762204 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430d33-41ee-48c3-9289-921cedc74e28 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.771432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.771750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.772196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.800168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] MFA Rules not processed for user `a08911ab0b8546ecba185aa3df2b7b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:30.801793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.805567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:30.815416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.816113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.816412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.816706 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.818563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.875703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1345/2675] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:30.882561 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.884004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f8db9-78b5-4ca3-b0d0-ddb690e6cfcf service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.886831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:30.888249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:30.893203 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1331/2676] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:30.899960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc6875-608c-4679-83f8-160f4e02958c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:30.903653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:30.904538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:30.904814 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:30.905085 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:30.915541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:30.917016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:30.927845 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1346/2677] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:32.440709 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096133-9f2d-4e50-a611-8e1ae631b24c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:32.441283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096133-9f2d-4e50-a611-8e1ae631b24c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:32.441283 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096133-9f2d-4e50-a611-8e1ae631b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:32.459747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-63096133-9f2d-4e50-a611-8e1ae631b24c None None] MFA Rules not processed for user `a08911ab0b8546ecba185aa3df2b7b30`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:32.461055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-63096133-9f2d-4e50-a611-8e1ae631b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:32.468737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1332/2678] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:33.461039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:33.524722 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66e0e-464c-4b13-92f4-e46b59971eb6 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:33.529676 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:33.530547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:33.530816 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:33.531080 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] PATH_INFO: `/v3/users/d9c9f9ca989a4d43903a6233a8828cfb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:33.532338 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c9f9ca989a4d43903a6233a8828cfb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:33.534247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:33.587450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c9f9ca989a4d43903a6233a8828cfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:33.597502 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c9f9ca989a4d43903a6233a8828cfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:33.609876 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c9f9ca989a4d43903a6233a8828cfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:33.610551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c9f9ca989a4d43903a6233a8828cfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:33.611188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c9f9ca989a4d43903a6233a8828cfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:33.612479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:33.626489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1347/2679] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:33 2022] DELETE /identity/v3/users/d9c9f9ca989a4d43903a6233a8828cfb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:33.630739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:33.631229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:33.631229 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:33.650786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:33.652113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:33.712315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1333/2680] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:33.722523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:33.723997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:33.787334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b303a88-7d45-45ab-b5e0-7227675b30bc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:33.793431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:33.794302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:33.794627 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:33.794908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:33.805772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:33.807217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:33.816929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1348/2681] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:34.485833 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:34.487339 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:34.501020 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c467b-b58d-499d-a728-8ec6913e51b1 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:34.506238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:34.507426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:34.507691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:34.508061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] PATH_INFO: `/v3/projects/4126a6ee4d094ace8083ca61289136f5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:34.509538 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4126a6ee4d094ace8083ca61289136f5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:34.511648 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:34.570842 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4126a6ee4d094ace8083ca61289136f5', 'request_id': 'req-2a9deaa3-2f8b-494b-94a2-51adffcb903c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.582797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4126a6ee4d094ace8083ca61289136f5', 'request_id': 'req-2a9deaa3-2f8b-494b-94a2-51adffcb903c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.591703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4126a6ee4d094ace8083ca61289136f5', 'request_id': 'req-2a9deaa3-2f8b-494b-94a2-51adffcb903c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.612763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] The token cache is being invalidate because project 4126a6ee4d094ace8083ca61289136f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:34.613126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.613702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.615309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1334/2682] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:34 2022] DELETE /identity/v3/projects/4126a6ee4d094ace8083ca61289136f5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:34.621483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:34.633639 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a690ccaf-294c-4dad-9db0-1f87689fed44 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:34.703718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:34.705335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:34.705996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:34.706473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] PATH_INFO: `/v3/users/2b7b30954e3b45748728dff181750e82` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:34.707940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b7b30954e3b45748728dff181750e82)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:34.710225 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:34.793052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b7b30954e3b45748728dff181750e82'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.804221 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b7b30954e3b45748728dff181750e82'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.824617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b7b30954e3b45748728dff181750e82'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.825666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b7b30954e3b45748728dff181750e82'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.827273 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aad66a12-e434-4f82-ac0a-484b39764e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b7b30954e3b45748728dff181750e82'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:34.849063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1349/2683] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:34 2022] DELETE /identity/v3/users/2b7b30954e3b45748728dff181750e82 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:35.138760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.140375 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:35.155201 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9deaa3-2f8b-494b-94a2-51adffcb903c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.169582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:35.227654 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.228601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.228878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.229153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] PATH_INFO: `/v3/projects/f895199466f549db87d12d25ba2b1dfe` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.230370 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f895199466f549db87d12d25ba2b1dfe)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.232402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.290591 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f895199466f549db87d12d25ba2b1dfe', 'request_id': 'req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:35.301173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f895199466f549db87d12d25ba2b1dfe', 'request_id': 'req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:35.308314 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f895199466f549db87d12d25ba2b1dfe', 'request_id': 'req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:35.327763 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] The token cache is being invalidate because project f895199466f549db87d12d25ba2b1dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:35.328212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:35.331118 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4e644a4d-956b-4ef4-bfa1-f6dd8ada120b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:35.336226 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1335/2684] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:35 2022] DELETE /identity/v3/projects/f895199466f549db87d12d25ba2b1dfe => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:35.339518 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.339873 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.340257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.361306 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:35.362611 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:35.368249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:35.428320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1350/2685] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:35.436596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.436882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.437155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.457971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:35.459045 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:35.468265 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1336/2686] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:35.472548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.482462 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ed89b-db1e-4454-9faa-17bf9ba3fc87 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.487475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.488291 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.488641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.488980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.489796 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:35.490187 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.492057 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.504967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1351/2687] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 07 04:15:35.509483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.518996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c153090b-1461-4f36-abd4-f398bf8f205b None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.525989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.526662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.526941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.527210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.527911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.529854 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.560886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1337/2688] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:35 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:35.562210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.574063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fce9b9-4890-412e-ae4a-30d14c00f621 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.652984 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.653838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.654501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.654501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.655343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.657527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.684297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1352/2689] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:35 2022] POST /identity/v3/users => generated 288 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:35.687969 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.700904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fd558-ed2b-4c9b-bbfa-7718299c4643 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.706813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.707813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.708290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.708707 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.709716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.711433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.723385 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1338/2690] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:35.727318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.739763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cec52-6b6b-4ccc-a86e-af71de707e1b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.745275 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.746041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.746410 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.746748 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.747558 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.749320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65e278-668d-449e-8e09-98b2a0122a82 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.760572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1353/2691] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:35.764977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:35.775691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d41829-fd64-42e1-9362-25208f0721c4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:35.780705 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:35.781770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.782108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.782429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] PATH_INFO: `/v3/projects/50c6364299a64f82b34b784abf9135b6/users/6653139a51354eb6aecefc7dcdf0af3e/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.798537 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c6364299a64f82b34b784abf9135b6, user_id=6653139a51354eb6aecefc7dcdf0af3e, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:35.801352 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:35.818585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1339/2692] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:35 2022] PUT /identity/v3/projects/50c6364299a64f82b34b784abf9135b6/users/6653139a51354eb6aecefc7dcdf0af3e/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:35.889112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:35.889400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:35.889672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:35.920098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] MFA Rules not processed for user `6653139a51354eb6aecefc7dcdf0af3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:35.921573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:36.015855 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1354/2693] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:36.030115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:36.032609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:36.096198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:36.111768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6b4b6-699c-4d84-a12e-d5bbe7c4917e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:36.115609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:36.116245 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:36.116585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:36.116863 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:36.125920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:36.127361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d354bb-a1a0-42ad-ad0c-9113823684bf service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:36.136243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1340/2694] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:39.198642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:39.210400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:39.273249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f568f-68c7-4f62-ada6-5cfdcf1038d5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:39.278450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925505-d942-4320-af20-136fb095a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:39.279358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925505-d942-4320-af20-136fb095a082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:39.279635 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925505-d942-4320-af20-136fb095a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:39.280007 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54925505-d942-4320-af20-136fb095a082 admin admin] PATH_INFO: `/v3/users/6653139a51354eb6aecefc7dcdf0af3e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:39.281255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54925505-d942-4320-af20-136fb095a082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6653139a51354eb6aecefc7dcdf0af3e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:39.283176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54925505-d942-4320-af20-136fb095a082 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:39.336848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6653139a51354eb6aecefc7dcdf0af3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.345837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6653139a51354eb6aecefc7dcdf0af3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.361544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6653139a51354eb6aecefc7dcdf0af3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.362380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6653139a51354eb6aecefc7dcdf0af3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.362831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6653139a51354eb6aecefc7dcdf0af3e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.378267 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1355/2695] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:39 2022] DELETE /identity/v3/users/6653139a51354eb6aecefc7dcdf0af3e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:39.382811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:39.383328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:39.383328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:39.401937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:39.403173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:39.479968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1341/2696] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:39.490677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:39.492310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:39.552249 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54925505-d942-4320-af20-136fb095a082 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:39.556277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:39.556941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:39.557220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:39.557489 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:39.567795 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:39.569601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a3943e-051a-46e8-917f-c3806da3eb98 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:39.580844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1356/2697] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:39.857414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:39.860069 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:39.879954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c8a6b1-8fab-41df-abaf-d3e867cea9cb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:39.884989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:39.885868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:39.886139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:39.886405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] PATH_INFO: `/v3/projects/50c6364299a64f82b34b784abf9135b6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:39.887751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c6364299a64f82b34b784abf9135b6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:39.889715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:39.941078 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c6364299a64f82b34b784abf9135b6', 'request_id': 'req-497227ea-4805-4d40-a28b-53171c77ac5c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.951699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c6364299a64f82b34b784abf9135b6', 'request_id': 'req-497227ea-4805-4d40-a28b-53171c77ac5c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.957920 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c6364299a64f82b34b784abf9135b6', 'request_id': 'req-497227ea-4805-4d40-a28b-53171c77ac5c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.969760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] The token cache is being invalidate because project 50c6364299a64f82b34b784abf9135b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:39.970042 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.970664 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:39.972294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1342/2698] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:39 2022] DELETE /identity/v3/projects/50c6364299a64f82b34b784abf9135b6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:47.733038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda6b5-dd38-4cba-a9e8-1e1cba557b99 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:47.733527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda6b5-dd38-4cba-a9e8-1e1cba557b99 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:47.733646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afda6b5-dd38-4cba-a9e8-1e1cba557b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:47.752075 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0afda6b5-dd38-4cba-a9e8-1e1cba557b99 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:47.753322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0afda6b5-dd38-4cba-a9e8-1e1cba557b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:47.779295 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:47.814293 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1357/2699] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:15:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:47.827535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:47.829167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:47.898932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497227ea-4805-4d40-a28b-53171c77ac5c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:47.904524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:47.905176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:47.905457 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:47.905731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:47.914181 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:47.915775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:47.919284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:47.924849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1343/2700] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:48.464051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd4f7-bbce-41e1-95fe-568d3da2e549 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:48.464373 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd4f7-bbce-41e1-95fe-568d3da2e549 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:48.464646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd4f7-bbce-41e1-95fe-568d3da2e549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:48.482640 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9e0cd4f7-bbce-41e1-95fe-568d3da2e549 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:48.483927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9e0cd4f7-bbce-41e1-95fe-568d3da2e549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:48.491590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1358/2701] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:48.503929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:48.514634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2098b-75b1-46e6-992f-53cb2d050771 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:48.519953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:48.520620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:48.520898 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:48.521162 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:48.529445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:48.531033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:48.539779 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1344/2702] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:48.735478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03cb7d-6bcf-4753-b6ea-7546b80ac1d6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:48.735967 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03cb7d-6bcf-4753-b6ea-7546b80ac1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:48.736069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03cb7d-6bcf-4753-b6ea-7546b80ac1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:48.753629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2a03cb7d-6bcf-4753-b6ea-7546b80ac1d6 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:48.754815 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2a03cb7d-6bcf-4753-b6ea-7546b80ac1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:48.762122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1359/2703] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:15:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:48.773844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:48.789355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efd713-0ba4-4c2b-9b92-ea2c6d044020 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:48.794797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:48.795443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:48.795719 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:48.795988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:48.804746 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:48.806962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:48.816818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1345/2704] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:49.159374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:49.159657 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:49.159930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:49.178432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:49.179615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:49.187185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1360/2705] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:15:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:49.199402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:49.210528 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e1841-1537-42be-a6fc-b1daa7e98bb7 service swift] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:49.216176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:49.216851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:49.217130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:49.217406 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:49.225836 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:49.227481 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67f13ff-36a3-4f94-9580-b3039e8e79bb service swift] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:49.235661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1346/2706] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:15:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:15:51.319717 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:51.321342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.396028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b6b7d-4304-4584-b287-e3295edf71b0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:51.401342 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:51.402517 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.402846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.403130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] PATH_INFO: `/v3/users/a08911ab0b8546ecba185aa3df2b7b30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.404588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a08911ab0b8546ecba185aa3df2b7b30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:51.406938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:51.460335 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a08911ab0b8546ecba185aa3df2b7b30'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.468724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a08911ab0b8546ecba185aa3df2b7b30'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.483270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a08911ab0b8546ecba185aa3df2b7b30'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.484037 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a08911ab0b8546ecba185aa3df2b7b30'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.484770 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a08911ab0b8546ecba185aa3df2b7b30'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.498553 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1361/2707] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:51 2022] DELETE /identity/v3/users/a08911ab0b8546ecba185aa3df2b7b30 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:51.503221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.503747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.504105 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.526255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:51.527565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.591341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1347/2708] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:51.601641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:51.603077 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.639610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:51.665561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025bfaf-4221-438e-859d-43de6544c26b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:51.669596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:51.670330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.670745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.671112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.680875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:51.682448 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a254f-3522-4d45-b0f9-1d702f5a4f8d service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:51.692929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1362/2709] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:51.743962 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:51.745551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.757989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b275f9-42a1-4e88-ba96-adaa6e0c75fb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:51.763271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:51.764209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.764486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.764757 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] PATH_INFO: `/v3/users/6dfd68c8de8c4a1d813d967c88b76012` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.766000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dfd68c8de8c4a1d813d967c88b76012)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:51.767933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:51.819747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dfd68c8de8c4a1d813d967c88b76012'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.827464 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dfd68c8de8c4a1d813d967c88b76012'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.828169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dfd68c8de8c4a1d813d967c88b76012'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.828796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dfd68c8de8c4a1d813d967c88b76012'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.843019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dfd68c8de8c4a1d813d967c88b76012'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:51.856878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1348/2710] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:51 2022] DELETE /identity/v3/users/6dfd68c8de8c4a1d813d967c88b76012 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:51.861491 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.861793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.862070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.874813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:51.876505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.881180 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:51.882510 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.918572 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:51.947615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1363/2711] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:51.956748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590459a-7f1b-49ba-8741-70864d009dd2 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:51.957557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:51.958913 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:51.961653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:51.962555 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:51.962829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:51.963129 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] PATH_INFO: `/v3/projects/a648f56261ed48709e60287fb0957ce6` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:51.964755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a648f56261ed48709e60287fb0957ce6)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:51.966360 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.013274 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a648f56261ed48709e60287fb0957ce6', 'request_id': 'req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.015255 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c468f7f-c5d5-47b3-a1b9-f8d99e45c0ff None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.020999 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a648f56261ed48709e60287fb0957ce6', 'request_id': 'req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.026925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a648f56261ed48709e60287fb0957ce6', 'request_id': 'req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.038170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] The token cache is being invalidate because project a648f56261ed48709e60287fb0957ce6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:52.038455 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.039102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-91c5c6fd-03d0-4a04-96c7-48e2a48b09e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.040702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1349/2712] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:51 2022] DELETE /identity/v3/projects/a648f56261ed48709e60287fb0957ce6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:52.045665 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2170-4476-4247-bbb2-704dad7018e7 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.045886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2170-4476-4247-bbb2-704dad7018e7 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.046160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2170-4476-4247-bbb2-704dad7018e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.063881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ca5a2170-4476-4247-bbb2-704dad7018e7 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:52.064073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.064745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.065022 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.065148 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ca5a2170-4476-4247-bbb2-704dad7018e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.065294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.067058 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.114374 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:52.125093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1350/2713] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:52.132759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.132912 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.133157 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.133432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.134215 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.143865 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1364/2714] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:52.151749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:52.152993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.164686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1351/2715] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:52.165892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.175618 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c846f8-f6b2-44e7-90dd-61aec583d670 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.180343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.181017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.181297 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.181572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.182638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:52.182638 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.184276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.197548 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1365/2716] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:52.201937 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.211448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf6a8d-24cb-42a5-9b20-9be81f1fbcc5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.217459 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.218179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.218474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.218722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.219443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.221403 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.252196 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1352/2717] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:52 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:52.253470 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.263790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a061c1d-81ce-4fdb-a790-5cf6d8a7253b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.330759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.331438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.331730 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.332005 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.332749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.334693 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.358790 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1366/2718] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:52 2022] POST /identity/v3/users => generated 296 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:52.360110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.370895 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ba93-1997-4f81-9db1-ece3683f0e23 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.375936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.376678 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.376959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.377486 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.378113 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.379823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.390992 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1353/2719] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:52.395229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.406071 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a92e1-202c-4af0-903a-a5a2f897a06b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.411979 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.412743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.413026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.413287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.414019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.415625 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.420882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.422715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.428193 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1367/2720] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:52.433752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.437530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaf0b-26b0-4ef7-a463-48a90f9d015e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.442332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.443337 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.443756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.444178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] PATH_INFO: `/v3/projects/5e3903fed65f40cdbf0fa7b22a8d3208` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.445666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e3903fed65f40cdbf0fa7b22a8d3208)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.447950 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.448096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d896d-8bed-4318-80e8-04ba34975d8b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.453181 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.454131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.454409 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.454681 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] PATH_INFO: `/v3/projects/aa6728aea8094c7ca42e984a5354dbaf/users/35e503f4ff914ba9ab03a2d22b37ddfa/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.466822 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:52.470399 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6728aea8094c7ca42e984a5354dbaf, user_id=35e503f4ff914ba9ab03a2d22b37ddfa, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.473142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.489690 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1368/2721] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:52 2022] PUT /identity/v3/projects/aa6728aea8094c7ca42e984a5354dbaf/users/35e503f4ff914ba9ab03a2d22b37ddfa/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:52.500006 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e3903fed65f40cdbf0fa7b22a8d3208', 'request_id': 'req-a51b18e6-0f18-445b-aee3-01bd84892728'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.509474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e3903fed65f40cdbf0fa7b22a8d3208', 'request_id': 'req-a51b18e6-0f18-445b-aee3-01bd84892728'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.517642 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e3903fed65f40cdbf0fa7b22a8d3208', 'request_id': 'req-a51b18e6-0f18-445b-aee3-01bd84892728'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.530392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] The token cache is being invalidate because project 5e3903fed65f40cdbf0fa7b22a8d3208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:52.530679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.531344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-a51b18e6-0f18-445b-aee3-01bd84892728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.532989 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1354/2722] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:52 2022] DELETE /identity/v3/projects/5e3903fed65f40cdbf0fa7b22a8d3208 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:52.537278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.539079 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.554862 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.555211 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.555501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.583650 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] MFA Rules not processed for user `35e503f4ff914ba9ab03a2d22b37ddfa`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:52.584964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.604675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c807614-eb0f-4bc1-847e-a92554c0491e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.632923 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:52.650034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1355/2723] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:52.660388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.661255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:52.661370 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.661538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.661807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] PATH_INFO: `/v3/users/3258cec747914a3bb7624f513d4ef970` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.662905 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:52.663020 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3258cec747914a3bb7624f513d4ef970)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.664959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.716262 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3258cec747914a3bb7624f513d4ef970'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.725391 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ad985-7396-41d5-a981-f9a467c7b19a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:52.725574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3258cec747914a3bb7624f513d4ef970'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.729376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:52.730065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:52.730346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:52.730617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:52.739417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:52.740314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3258cec747914a3bb7624f513d4ef970'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.740884 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:52.740994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3258cec747914a3bb7624f513d4ef970'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.741738 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-97087dd9-efc2-41b6-87ed-43bc3fd46cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3258cec747914a3bb7624f513d4ef970'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:52.750268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1356/2724] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:15:52.754918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1369/2725] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:52 2022] DELETE /identity/v3/users/3258cec747914a3bb7624f513d4ef970 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:53.054734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.067491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819b9e8-34e1-4854-8dbc-b5628365adc5 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.109174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:53.134633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.135569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.135848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.136168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] PATH_INFO: `/v3/projects/2ee4d363370849fa88bcd6793208451b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.137344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ee4d363370849fa88bcd6793208451b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.139252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.188996 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ee4d363370849fa88bcd6793208451b', 'request_id': 'req-c14c257e-2461-4e09-8ff7-05d72344528e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:53.197624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ee4d363370849fa88bcd6793208451b', 'request_id': 'req-c14c257e-2461-4e09-8ff7-05d72344528e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:53.203754 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ee4d363370849fa88bcd6793208451b', 'request_id': 'req-c14c257e-2461-4e09-8ff7-05d72344528e'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:53.217597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] The token cache is being invalidate because project 2ee4d363370849fa88bcd6793208451b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:53.217885 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:53.218557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-c14c257e-2461-4e09-8ff7-05d72344528e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:53.220143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1357/2726] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:53 2022] DELETE /identity/v3/projects/2ee4d363370849fa88bcd6793208451b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:53.225302 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.225591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.225870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.243982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:53.245379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:53.310996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1370/2727] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:53.319024 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.319318 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.319594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.340140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:53.341344 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:53.349907 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1358/2728] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:53.354170 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.364107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0478be-11d9-4dd5-9566-28fcfad9c288 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.369494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.370158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.370463 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.370732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.371460 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:53.371762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.373451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.385108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1371/2729] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:53.389502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.399236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d02b328-808d-4620-8a9f-6e60497641bb None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.404603 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.405252 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.405526 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.405794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.406525 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.408449 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.438295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1359/2730] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:53.442442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.452921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fbbf7-3657-4490-b99c-02140833d6a5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.486251 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:53.511159 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.511863 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.512196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.512468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.513175 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.515090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.536948 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1372/2731] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:53.541292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.552626 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94661906-781d-42b9-9551-fe25d05cb1ba admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.557829 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.558491 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.558768 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.559032 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.559805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.561446 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.573303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1360/2732] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:53.577810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.588340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d397ba7-152f-4579-a1f5-27524b66b9fe admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.593479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.594131 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.594404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.594677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.595398 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.597039 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaba24-f7a2-41c3-ab28-15c8c19dce54 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.607478 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1373/2733] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:53.611547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.621927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a6b2-9bbb-462e-b107-2a5b049f9214 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.628062 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.629103 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.629361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.629695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] PATH_INFO: `/v3/projects/d74a1af64c9e45dbb8f97fca55c38725/users/aab84898622f4ca18e9d07565cb4bf92/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.646782 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74a1af64c9e45dbb8f97fca55c38725, user_id=aab84898622f4ca18e9d07565cb4bf92, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.649726 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.663210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1361/2734] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:53 2022] PUT /identity/v3/projects/d74a1af64c9e45dbb8f97fca55c38725/users/aab84898622f4ca18e9d07565cb4bf92/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:53.674433 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.674721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.674997 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.706107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] MFA Rules not processed for user `aab84898622f4ca18e9d07565cb4bf92`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:53.707161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:53.775430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1374/2735] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:53.780303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.845257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e097ef-1ab0-4bdf-b81f-7a4b9b4a6f76 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.850949 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.851628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.851901 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.852194 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.852887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.854939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.863195 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:53.884811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1362/2736] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:53.889047 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:53.899833 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a93ab6-27c5-4c36-ab2b-a6f7c4e9256d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:53.960154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:53.960858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:53.961141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:53.961411 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:53.962109 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:53.964110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:53.989981 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1375/2737] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:53 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:53.991250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.002588 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb451266-75aa-4932-9da2-146f28c58054 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.008159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.009000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.009281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.009552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.010298 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.011902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.023064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1363/2738] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:15:54.027234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.037912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079f76e-a4eb-40e0-9bbb-268702f383f7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.043801 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.044810 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.045088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.045383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] PATH_INFO: `/v3/projects/b54ce73ed0284103a7932390d1035202/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.061227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54ce73ed0284103a7932390d1035202, user_id=0d9aa0e6e62a446fa840ba8aaa3ff9eb, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.063872 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.079457 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1376/2739] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:54 2022] PUT /identity/v3/projects/b54ce73ed0284103a7932390d1035202/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:54.083727 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.093951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe527f04-f132-46f9-8009-6da386ddca78 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.155604 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.156319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.156602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.156873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.157641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.159299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf898ac-1164-4869-9ace-eaad364bf7a4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.170253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1364/2740] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:54.175308 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.187201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bab1c-a286-4a64-86f2-5e0752023daf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.193074 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.194177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.194569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.194958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] PATH_INFO: `/v3/projects/b54ce73ed0284103a7932390d1035202/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.197233 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54ce73ed0284103a7932390d1035202, user_id=0d9aa0e6e62a446fa840ba8aaa3ff9eb, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.200572 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.206727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:54.213493 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1377/2741] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:54 2022] PUT /identity/v3/projects/b54ce73ed0284103a7932390d1035202/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:54.223753 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.224110 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.225004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.268786 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] MFA Rules not processed for user `0d9aa0e6e62a446fa840ba8aaa3ff9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:54.271137 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:54.343980 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1365/2742] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:54 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:54.355957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.357917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:54.418743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec6848-5fe9-4bc0-9a8f-4e3d5314a716 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.423320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.423985 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.424263 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.424525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.434082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.435526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.444897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1378/2743] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:54.489341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:54.490780 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:54.503104 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fdb49-dff1-42be-a33e-c7cd91d19f74 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:54.507130 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:54.507760 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:54.508034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:54.508330 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:54.564692 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:54.566117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eecac7-734c-44ab-9675-67338b7f41f2 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:54.569605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:54.576569 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1366/2744] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:57.944439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:58.015664 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbf26-b759-4089-b4d5-cbb13344ae4d service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:58.020190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:58.021082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:58.021361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:58.021785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] PATH_INFO: `/v3/users/aab84898622f4ca18e9d07565cb4bf92` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:58.022970 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab84898622f4ca18e9d07565cb4bf92)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:58.024925 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:58.076861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab84898622f4ca18e9d07565cb4bf92'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.086171 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab84898622f4ca18e9d07565cb4bf92'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.102878 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab84898622f4ca18e9d07565cb4bf92'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.103667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab84898622f4ca18e9d07565cb4bf92'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.104444 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab84898622f4ca18e9d07565cb4bf92'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.118523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1379/2745] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:57 2022] DELETE /identity/v3/users/aab84898622f4ca18e9d07565cb4bf92 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:58.123279 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:58.123751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:58.123866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:58.142055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:58.143240 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:58.203883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1367/2746] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:58.213798 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:58.215432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:58.239247 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:58.282958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca70ff-9c00-4982-a133-1510ea571e3c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:58.286644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:58.287309 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:58.287584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:58.287852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:58.298015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:58.299494 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:58.310208 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1380/2747] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:15:58.580883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:58.582567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:58.595379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b03e5-5e82-43ba-a325-81d0caf5bfaf None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:58.600243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:58.601818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:58.602278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:58.602568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] PATH_INFO: `/v3/projects/d74a1af64c9e45dbb8f97fca55c38725` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:58.603796 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74a1af64c9e45dbb8f97fca55c38725)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:58.606284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:58.655722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74a1af64c9e45dbb8f97fca55c38725', 'request_id': 'req-46927774-b223-4345-8ea3-76eb1e88959f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.663440 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74a1af64c9e45dbb8f97fca55c38725', 'request_id': 'req-46927774-b223-4345-8ea3-76eb1e88959f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.669033 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74a1af64c9e45dbb8f97fca55c38725', 'request_id': 'req-46927774-b223-4345-8ea3-76eb1e88959f'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.680609 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] The token cache is being invalidate because project d74a1af64c9e45dbb8f97fca55c38725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:58.680904 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.681622 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.683372 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1368/2748] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:58 2022] DELETE /identity/v3/projects/d74a1af64c9e45dbb8f97fca55c38725 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:58.687747 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:58.697903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef7220b-2e5e-4e53-93ad-c2cdbbddd1dc service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:58.757762 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:58.758648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:58.758921 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:58.759190 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] PATH_INFO: `/v3/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:58.760540 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d9aa0e6e62a446fa840ba8aaa3ff9eb)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:58.762543 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:58.811893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d9aa0e6e62a446fa840ba8aaa3ff9eb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.819689 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d9aa0e6e62a446fa840ba8aaa3ff9eb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.832218 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d9aa0e6e62a446fa840ba8aaa3ff9eb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.832854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d9aa0e6e62a446fa840ba8aaa3ff9eb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.833454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8d391009-2955-46e4-9e63-2a3c8d5b5570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d9aa0e6e62a446fa840ba8aaa3ff9eb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:58.846578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1381/2749] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:15:58 2022] DELETE /identity/v3/users/0d9aa0e6e62a446fa840ba8aaa3ff9eb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:59.157574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.159172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:59.174730 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46927774-b223-4345-8ea3-76eb1e88959f admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.236155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.237074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.237355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.237620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] PATH_INFO: `/v3/projects/b54ce73ed0284103a7932390d1035202` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.238911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54ce73ed0284103a7932390d1035202)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.240886 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.266896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:59.292818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54ce73ed0284103a7932390d1035202', 'request_id': 'req-4fffae0c-9366-48e8-b506-d5700408447c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:59.301922 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54ce73ed0284103a7932390d1035202', 'request_id': 'req-4fffae0c-9366-48e8-b506-d5700408447c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:59.308783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54ce73ed0284103a7932390d1035202', 'request_id': 'req-4fffae0c-9366-48e8-b506-d5700408447c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:59.323102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] The token cache is being invalidate because project b54ce73ed0284103a7932390d1035202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:15:59.323295 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:59.324035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-4fffae0c-9366-48e8-b506-d5700408447c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:15:59.325933 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1369/2750] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:15:59 2022] DELETE /identity/v3/projects/b54ce73ed0284103a7932390d1035202 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:15:59.331278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.331726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.331848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.350505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:59.351726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:59.390752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:15:59.412498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1382/2751] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:59.421806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.422076 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.422346 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.441787 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:59.443028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:59.451792 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1370/2752] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:15:59.456142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.466541 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603402-2907-4742-be76-fbf6bdd91b2b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.472706 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.473481 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.473838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.474242 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.475432 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:15:59.476051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.477825 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.492468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1383/2753] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:15:59.496941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.507444 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973ff10-d4c8-4694-aac5-2d2580398dda None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.512581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.513253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.513530 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.513815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.514567 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.516568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.550123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1371/2754] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:15:59.554351 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.565435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab2ec9-00e9-4539-8125-be1a767e08e1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.621666 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.622272 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.622551 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.622826 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.623529 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.625479 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.650400 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1384/2755] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:15:59.656174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.668093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a512eba-71a4-4fc5-8e42-3e770413ae5c admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.673770 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.674437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.674712 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.674976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.675716 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.677351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.688234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1372/2756] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:59.692383 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.703224 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285bdf6-ba3c-4065-aebc-4e90cfc45d60 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.708912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.709576 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.709903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.710163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.710894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.712573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ccd78-2081-4005-942d-88e511ce6f79 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.722987 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1385/2757] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:15:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:15:59.727254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.740513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfacba89-3d9b-475f-ac6b-e3a667530bb5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.746383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.747292 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.747568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.747839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] PATH_INFO: `/v3/projects/00689cc08f714d1e850b6f2869007153/users/77cce8ec5fd5413dae2e376fefe4140c/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.763956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00689cc08f714d1e850b6f2869007153, user_id=77cce8ec5fd5413dae2e376fefe4140c, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.766655 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:15:59.787568 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1373/2758] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:15:59 2022] PUT /identity/v3/projects/00689cc08f714d1e850b6f2869007153/users/77cce8ec5fd5413dae2e376fefe4140c/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:15:59.800336 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.800621 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.800892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.830288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] MFA Rules not processed for user `77cce8ec5fd5413dae2e376fefe4140c`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:15:59.831556 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:15:59.905579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1386/2759] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:15:59.910445 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:15:59.976789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c83dd1-7cd8-4f2a-a7b4-0dcf55a1222a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:15:59.981929 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:15:59.982599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:15:59.982878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:15:59.983147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:15:59.983860 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:15:59.985820 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.013644 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1374/2760] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:15:59 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:00.018158 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.029377 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227635e-3d58-45d9-b435-016a29bb3bec None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.063082 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:00.094975 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.095667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.095944 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.096239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.096960 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.098922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.119848 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1387/2761] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:00 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:00.124132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.134563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6750a4-6fbb-4908-97e7-82745620d8f0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.139393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.140050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.140358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.140613 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.141343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.142925 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.153578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1375/2762] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:00.157736 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.169820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee21d9a-337d-4dee-b6d0-e33b8c5ac539 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.178647 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.179893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.180277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.180646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] PATH_INFO: `/v3/projects/88ebad27d3774f438477d0ba01b16f04/users/52749d56a2904d3c84cac4413265521c/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.198076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ebad27d3774f438477d0ba01b16f04, user_id=52749d56a2904d3c84cac4413265521c, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.201179 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.217965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1388/2763] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:00 2022] PUT /identity/v3/projects/88ebad27d3774f438477d0ba01b16f04/users/52749d56a2904d3c84cac4413265521c/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:00.222448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.233808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e800fff-f974-4993-b919-dc57f4db33b0 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.253249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:00.294623 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.295345 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.295625 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.295892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.296676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.298263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59153d15-192c-423e-a568-55369d7ea749 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.308570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1376/2764] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:00.313063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.324016 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02173b7-0ab0-435d-afe3-2b158953a1a9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.330010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.330901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.331172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.331442 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] PATH_INFO: `/v3/projects/88ebad27d3774f438477d0ba01b16f04/users/52749d56a2904d3c84cac4413265521c/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.333485 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ebad27d3774f438477d0ba01b16f04, user_id=52749d56a2904d3c84cac4413265521c, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.336107 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.346741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1389/2765] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:00 2022] PUT /identity/v3/projects/88ebad27d3774f438477d0ba01b16f04/users/52749d56a2904d3c84cac4413265521c/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:00.357000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.357289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.357565 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.386462 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] MFA Rules not processed for user `52749d56a2904d3c84cac4413265521c`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:00.387691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:00.457434 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1377/2766] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:00.469446 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:00.471557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:00.533606 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b5ba-ac71-4cab-9b19-6e40dc653895 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:00.538149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:00.538799 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:00.539076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:00.539344 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:00.608914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:00.610554 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:00.620341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1390/2767] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:01.972818 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:01.986005 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74a66c-6191-4e41-8e92-fa405105ff5e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:01.991270 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:01.991918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:01.992225 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:01.992495 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:02.003190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:02.004695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b8b27-8e24-45fd-ac99-11410ce45e38 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:02.014731 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1378/2768] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:02.833982 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:02.835547 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:02.885270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:02.904958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947956d-a69e-4a2a-98a3-f2e95d1f1a13 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:02.910015 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:02.910946 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:02.911227 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:02.911503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] PATH_INFO: `/v3/users/35e503f4ff914ba9ab03a2d22b37ddfa` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:02.912809 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e503f4ff914ba9ab03a2d22b37ddfa)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:02.915034 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:02.974406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e503f4ff914ba9ab03a2d22b37ddfa'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:02.982152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e503f4ff914ba9ab03a2d22b37ddfa'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:02.993844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e503f4ff914ba9ab03a2d22b37ddfa'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:02.994468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e503f4ff914ba9ab03a2d22b37ddfa'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:02.995138 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e503f4ff914ba9ab03a2d22b37ddfa'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.008156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1391/2769] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:02 2022] DELETE /identity/v3/users/35e503f4ff914ba9ab03a2d22b37ddfa => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:03.012951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.013492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.013492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.031637 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:03.032850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:03.092805 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1379/2770] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:03.104303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.105952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:03.164150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2980f-9c1a-42d6-bf01-d95321a31263 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.168177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.168813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.169086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.169384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.179300 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.181019 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8920e0-0563-4591-ba6e-3c7d29aa5200 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.190906 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1392/2771] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:03.467790 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.469671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:03.484022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fc624-e8dd-4ffa-882b-37496355daac None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.490369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.491278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.491554 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.491991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] PATH_INFO: `/v3/projects/aa6728aea8094c7ca42e984a5354dbaf` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.493407 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6728aea8094c7ca42e984a5354dbaf)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.495514 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.535943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:03.555534 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6728aea8094c7ca42e984a5354dbaf', 'request_id': 'req-56f1b8ff-14f4-483b-ab7e-6d199a206621'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.565405 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6728aea8094c7ca42e984a5354dbaf', 'request_id': 'req-56f1b8ff-14f4-483b-ab7e-6d199a206621'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.571254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6728aea8094c7ca42e984a5354dbaf', 'request_id': 'req-56f1b8ff-14f4-483b-ab7e-6d199a206621'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.582767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] The token cache is being invalidate because project aa6728aea8094c7ca42e984a5354dbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:03.583052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.583693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-56f1b8ff-14f4-483b-ab7e-6d199a206621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:03.585288 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1380/2772] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:03 2022] DELETE /identity/v3/projects/aa6728aea8094c7ca42e984a5354dbaf => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:03.590276 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.590559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.590829 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.609742 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:03.610875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:03.673779 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1393/2773] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:16:03.681695 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.681976 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.682249 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.703738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:03.705007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:03.714448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1381/2774] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:03.718962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.729353 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdec27-29d8-4125-98cb-8d68b4c5caac None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.737893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.738724 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.739017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.739310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.740417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:03.740741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.743021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.745166 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:03.758588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1394/2775] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:03.763092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.772951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc16773-461b-4175-bb59-47bdbe90b85d None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.777656 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.778343 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.778621 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.778897 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.779614 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.781557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.813153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1382/2776] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:03 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:16:03.818728 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.834001 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758579db-d912-4c2b-913a-7718af2f50d9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.898156 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.898777 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.899053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.899323 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.900013 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.902006 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.925667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1395/2777] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:03 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:03.930022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.941326 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844989ff-167c-412c-b007-30ecb697721a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.946839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.947551 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.947827 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.948097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.948877 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.950830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.961832 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1383/2778] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:03.965995 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:03.976334 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7f1ef-0e5b-41e4-9da9-570473de826a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:03.981721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:03.982434 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:03.982710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:03.982980 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:03.983769 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:03.985438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c379617b-d093-49df-809a-a873d6cf86e2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:03.995752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1396/2779] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:04.000071 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:04.010281 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a92634-bf70-4d6c-b988-c20f1c851099 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:04.015097 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:04.015981 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:04.016296 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:04.016566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] PATH_INFO: `/v3/projects/ec6180542442421b8f63e94f24e338a7/users/4447c4fcc5c1439b98c936e80343e746/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:04.031602 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec6180542442421b8f63e94f24e338a7, user_id=4447c4fcc5c1439b98c936e80343e746, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:04.034268 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:04.049115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1384/2780] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:03 2022] PUT /identity/v3/projects/ec6180542442421b8f63e94f24e338a7/users/4447c4fcc5c1439b98c936e80343e746/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:04.060860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:04.061149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:04.061445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:04.089593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] MFA Rules not processed for user `4447c4fcc5c1439b98c936e80343e746`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:04.090938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:04.156198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1397/2781] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:04.168193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:04.170176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:04.233222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e220fa-10b6-46b4-a253-4cd919e2fed5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:04.237094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:04.237744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:04.238018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:04.238303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:04.247212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:04.248733 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144123ba-4a39-4104-9687-ed3d589d99f8 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:04.258112 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1385/2782] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:05.762645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:05.764368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:05.838049 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470ba8-adcd-4d63-8bc4-dedd5683f0a2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:05.843154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:05.844088 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:05.844422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:05.844696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] PATH_INFO: `/v3/users/77cce8ec5fd5413dae2e376fefe4140c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:05.846114 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cce8ec5fd5413dae2e376fefe4140c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:05.848070 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:05.850542 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:05.899655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cce8ec5fd5413dae2e376fefe4140c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:05.909106 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cce8ec5fd5413dae2e376fefe4140c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:05.921929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cce8ec5fd5413dae2e376fefe4140c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:05.922610 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cce8ec5fd5413dae2e376fefe4140c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:05.923196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cce8ec5fd5413dae2e376fefe4140c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:05.936386 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1398/2783] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:05 2022] DELETE /identity/v3/users/77cce8ec5fd5413dae2e376fefe4140c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:05.941210 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:05.941672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:05.941756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:05.958918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:05.960158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:06.015686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:06.029830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1386/2784] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:16:06.039631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:06.041296 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:06.103893 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb783b63-20a0-47e3-944a-5d78033a64a8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:06.108021 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:06.108767 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:06.109041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:06.109305 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:06.119392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:06.120897 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:06.130569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1399/2785] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:06.403749 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:06.405276 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:06.417506 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff403f52-dc78-4e16-a390-c9548f110685 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:06.422535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:06.423510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:06.423835 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:06.424155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] PATH_INFO: `/v3/projects/00689cc08f714d1e850b6f2869007153` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:06.425424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00689cc08f714d1e850b6f2869007153)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:06.427300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:06.477207 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00689cc08f714d1e850b6f2869007153', 'request_id': 'req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.485532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00689cc08f714d1e850b6f2869007153', 'request_id': 'req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.492009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00689cc08f714d1e850b6f2869007153', 'request_id': 'req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.503739 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] The token cache is being invalidate because project 00689cc08f714d1e850b6f2869007153 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:06.504101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.504775 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.506373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1387/2786] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:06 2022] DELETE /identity/v3/projects/00689cc08f714d1e850b6f2869007153 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:06.510630 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:06.520837 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b1408-1347-4d79-bb81-99bee91b187b service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:06.579655 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:06.580578 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:06.580847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:06.581119 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] PATH_INFO: `/v3/users/52749d56a2904d3c84cac4413265521c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:06.582340 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52749d56a2904d3c84cac4413265521c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:06.584347 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:06.614644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:06.634745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52749d56a2904d3c84cac4413265521c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.642667 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52749d56a2904d3c84cac4413265521c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.654461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52749d56a2904d3c84cac4413265521c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.655087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52749d56a2904d3c84cac4413265521c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.655683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-79026e9b-1c09-41b0-8b6b-97f6123e2df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52749d56a2904d3c84cac4413265521c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:06.667683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1400/2787] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:06 2022] DELETE /identity/v3/users/52749d56a2904d3c84cac4413265521c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:06.949234 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:06.951323 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:06.976332 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a2ca8c-1441-43d3-8629-b601a0cb0bc9 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.041582 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.042468 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.044065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.044065 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] PATH_INFO: `/v3/projects/88ebad27d3774f438477d0ba01b16f04` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.044315 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ebad27d3774f438477d0ba01b16f04)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.046133 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.095171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ebad27d3774f438477d0ba01b16f04', 'request_id': 'req-1355eb63-0445-4293-b9bd-db80517a40e1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:07.104169 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ebad27d3774f438477d0ba01b16f04', 'request_id': 'req-1355eb63-0445-4293-b9bd-db80517a40e1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:07.109740 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ebad27d3774f438477d0ba01b16f04', 'request_id': 'req-1355eb63-0445-4293-b9bd-db80517a40e1'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:07.121182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] The token cache is being invalidate because project 88ebad27d3774f438477d0ba01b16f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:07.121467 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:07.122168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-1355eb63-0445-4293-b9bd-db80517a40e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:07.123793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1388/2788] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:06 2022] DELETE /identity/v3/projects/88ebad27d3774f438477d0ba01b16f04 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:07.128864 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.129345 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.129439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.147307 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:07.148537 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:07.210718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1401/2789] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:07.219840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.220139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.220513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.233377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:07.239806 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:07.241985 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:07.251052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1389/2790] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:07.255515 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.265831 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740b356-0150-446d-a734-cf20a21b3f57 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.271401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.272063 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.272516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.272835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.273561 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:07.273869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.275492 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.287819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1402/2791] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:07.292560 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.306576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f35848-55c8-4b79-8a87-12cc099a87c6 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.314844 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.315504 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.315783 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.316055 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.316800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.318703 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.352356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1390/2792] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:16:07.354136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.365042 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1cfdc-6cb1-4b85-b97a-0600b15fa1d0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.423422 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.424153 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.424428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.424699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.425385 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.427318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.452182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1403/2793] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:07.456570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.466928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b26d8-d66e-42b3-89be-d7aedd304f08 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.471683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.472379 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.472661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.472943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.473699 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.475327 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.485959 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1391/2794] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:07.490026 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.500713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f477b1-9588-4e1a-9de8-64cb7600b740 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.505958 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.506594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.506903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.507238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.507959 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.509692 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c44a4-3ccf-4726-8c4a-e295cd33425a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.520423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1404/2795] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:07.524789 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.535838 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eea0a-5b50-4d0f-9b85-cbba67b7e5f4 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.541316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.542223 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.542501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.542793 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] PATH_INFO: `/v3/projects/9d0d2857f02944dc815f568c91f5530d/users/ae45f196701441e0b2177e0232ce023a/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.558651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d0d2857f02944dc815f568c91f5530d, user_id=ae45f196701441e0b2177e0232ce023a, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.561394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.576977 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1392/2796] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:07 2022] PUT /identity/v3/projects/9d0d2857f02944dc815f568c91f5530d/users/ae45f196701441e0b2177e0232ce023a/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:07.587902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.588223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.588499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.607941 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:07.618443 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] MFA Rules not processed for user `ae45f196701441e0b2177e0232ce023a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:07.620112 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:07.689613 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1405/2797] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:07.695840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.763324 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91862-78e3-4b15-97e7-24208991140d admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.768869 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.769531 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.769811 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.770072 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.770816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.772701 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.801769 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1393/2798] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 07 04:16:07.806320 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.818445 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665a099-552a-429a-b4f4-aa5be8edfc7a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.878854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.879546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.879817 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.880086 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.880851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.882745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.907718 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1406/2799] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:07 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:07.911932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.922892 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ada25b-d7d6-4710-b405-a666ed18fb04 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.928280 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.928954 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.929233 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.929505 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.930244 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.931849 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.943953 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1394/2800] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:07.948304 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:07.959617 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108957de-f508-43cd-b637-e4e815580ccc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:07.964930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:07.965819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:07.966098 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:07.966369 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] PATH_INFO: `/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe/users/ede04ed43e5c4620af13fec6a7d9ad74/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:07.981916 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e5f9ac483948c2ba4d3b0788c721fe, user_id=ede04ed43e5c4620af13fec6a7d9ad74, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:07.984573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:07.999914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1407/2801] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:07 2022] PUT /identity/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe/users/ede04ed43e5c4620af13fec6a7d9ad74/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:08.005004 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:08.015218 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19add2-3061-41b9-9280-67ba2b5007aa admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:08.075795 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:08.076552 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.077007 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.077309 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.078092 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:08.079801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a749d9d-3dd6-4eb6-972a-011f76989d73 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:08.090061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1395/2802] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:08.094574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:08.106173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cd960-c2e9-4acb-a201-9d97bc300a46 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:08.111440 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:08.112391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.112668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.112938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] PATH_INFO: `/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe/users/ede04ed43e5c4620af13fec6a7d9ad74/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.115040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e5f9ac483948c2ba4d3b0788c721fe, user_id=ede04ed43e5c4620af13fec6a7d9ad74, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:08.117739 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:08.128956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1408/2803] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:08 2022] PUT /identity/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe/users/ede04ed43e5c4620af13fec6a7d9ad74/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:08.140164 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889733-71a5-4239-988f-3bec00a1976e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.140658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889733-71a5-4239-988f-3bec00a1976e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.140658 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00889733-71a5-4239-988f-3bec00a1976e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.165202 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:08.168990 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-00889733-71a5-4239-988f-3bec00a1976e None None] MFA Rules not processed for user `ede04ed43e5c4620af13fec6a7d9ad74`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:08.171189 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-00889733-71a5-4239-988f-3bec00a1976e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:08.246570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1396/2804] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:08.257521 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:08.259509 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:08.319196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70a1d7-1ceb-4554-adb2-82d6295a0beb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:08.322894 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:08.323750 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.323903 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.324148 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.331403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:08.335449 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:08.337536 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbcab60-d691-44a0-9289-83fc9b111359 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:08.347579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1409/2805] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:08.733294 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889733-71a5-4239-988f-3bec00a1976e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:08.796902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00889733-71a5-4239-988f-3bec00a1976e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:08.802068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:08.802946 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.803222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.803492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] PATH_INFO: `/v3/users/ae45f196701441e0b2177e0232ce023a` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.804756 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae45f196701441e0b2177e0232ce023a)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:08.806794 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:08.856250 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae45f196701441e0b2177e0232ce023a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:08.865002 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae45f196701441e0b2177e0232ce023a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:08.865823 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae45f196701441e0b2177e0232ce023a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:08.866475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae45f196701441e0b2177e0232ce023a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:08.879052 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae45f196701441e0b2177e0232ce023a'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:08.891257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1397/2806] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:08 2022] DELETE /identity/v3/users/ae45f196701441e0b2177e0232ce023a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:08.895991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:08.896311 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:08.896584 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:08.916559 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:08.917757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:08.977891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1410/2807] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:08.987878 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:08.989566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.011275 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:09.052261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f6c58-8315-4c42-b84b-6aebbfb254e3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:09.056143 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:09.056845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.057124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.057392 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.066667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:09.068138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:09.077874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1398/2808] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:09.249234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.250938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.263332 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda1381-c730-48ad-8ba7-4618d9ea2de5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:09.269072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:09.269956 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.270229 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.270501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] PATH_INFO: `/v3/users/4447c4fcc5c1439b98c936e80343e746` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.271735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4447c4fcc5c1439b98c936e80343e746)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:09.273721 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:09.321727 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4447c4fcc5c1439b98c936e80343e746'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.330330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4447c4fcc5c1439b98c936e80343e746'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.346844 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4447c4fcc5c1439b98c936e80343e746'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.347523 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4447c4fcc5c1439b98c936e80343e746'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.348152 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e19dca2-b165-4f30-a899-33184b32fd16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4447c4fcc5c1439b98c936e80343e746'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.354082 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.355909 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.369492 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfb7e4-e88c-4495-bcc0-7c8c217e7521 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:09.371752 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1411/2809] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:09 2022] DELETE /identity/v3/users/4447c4fcc5c1439b98c936e80343e746 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:09.374917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:09.375812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.376093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.376223 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.376517 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] PATH_INFO: `/v3/projects/9d0d2857f02944dc815f568c91f5530d` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.376626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.376804 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.377744 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d0d2857f02944dc815f568c91f5530d)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:09.379633 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:09.394473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:09.395677 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.428750 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d0d2857f02944dc815f568c91f5530d', 'request_id': 'req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.446653 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d0d2857f02944dc815f568c91f5530d', 'request_id': 'req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.453117 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d0d2857f02944dc815f568c91f5530d', 'request_id': 'req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.457823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1412/2810] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 07 04:16:09.464723 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] The token cache is being invalidate because project 9d0d2857f02944dc815f568c91f5530d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:09.465147 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.465819 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.467388 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1399/2811] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:09 2022] DELETE /identity/v3/projects/9d0d2857f02944dc815f568c91f5530d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:09.468890 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.470290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.471358 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.472683 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.479952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:09.531716 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154994c9-41c8-4f86-8300-21078e8190aa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:09.536018 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e8e99-1540-41cb-bb0c-3cbe10a08ba8 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:09.540679 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:09.541578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.541859 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.542132 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] PATH_INFO: `/v3/users/ede04ed43e5c4620af13fec6a7d9ad74` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.543363 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ede04ed43e5c4620af13fec6a7d9ad74)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:09.545311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:09.581248 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:09.582397 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:09.582594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:09.582867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:09.584726 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.592021 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:09.593752 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ede04ed43e5c4620af13fec6a7d9ad74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.596969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:09.598711 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:09.601911 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ede04ed43e5c4620af13fec6a7d9ad74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.602586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ede04ed43e5c4620af13fec6a7d9ad74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.603254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ede04ed43e5c4620af13fec6a7d9ad74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.609590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1413/2812] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 07 04:16:09.617329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ede04ed43e5c4620af13fec6a7d9ad74'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:09.629994 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1400/2813] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:09 2022] DELETE /identity/v3/users/ede04ed43e5c4620af13fec6a7d9ad74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:09.970487 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.972586 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.990285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:09.992170 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:09.996696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae36de-d616-422f-85bb-c8d6b9dcc51c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.065881 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22224055-42f5-41c1-bbd2-e1426a5a95c5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.070417 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.071289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.071590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.071861 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] PATH_INFO: `/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.073064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e5f9ac483948c2ba4d3b0788c721fe)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.074956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.077371 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.078316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.078632 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.078936 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] PATH_INFO: `/v3/projects/ec6180542442421b8f63e94f24e338a7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.080239 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec6180542442421b8f63e94f24e338a7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.082317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.122802 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e5f9ac483948c2ba4d3b0788c721fe', 'request_id': 'req-20370830-861e-4059-8c5b-eb20d937cc94'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.130487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e5f9ac483948c2ba4d3b0788c721fe', 'request_id': 'req-20370830-861e-4059-8c5b-eb20d937cc94'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.131277 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec6180542442421b8f63e94f24e338a7', 'request_id': 'req-02c868bb-4673-4f9b-a435-ffed29b73c88'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.135951 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e5f9ac483948c2ba4d3b0788c721fe', 'request_id': 'req-20370830-861e-4059-8c5b-eb20d937cc94'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.137915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec6180542442421b8f63e94f24e338a7', 'request_id': 'req-02c868bb-4673-4f9b-a435-ffed29b73c88'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.146389 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec6180542442421b8f63e94f24e338a7', 'request_id': 'req-02c868bb-4673-4f9b-a435-ffed29b73c88'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.149814 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] The token cache is being invalidate because project c7e5f9ac483948c2ba4d3b0788c721fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:10.150176 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.150896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-20370830-861e-4059-8c5b-eb20d937cc94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.152594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1401/2814] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:09 2022] DELETE /identity/v3/projects/c7e5f9ac483948c2ba4d3b0788c721fe => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:10.154725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:10.157596 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.157971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.158341 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.164459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] The token cache is being invalidate because project ec6180542442421b8f63e94f24e338a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:10.164758 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.165780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-02c868bb-4673-4f9b-a435-ffed29b73c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:10.167957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1414/2815] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:09 2022] DELETE /identity/v3/projects/ec6180542442421b8f63e94f24e338a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:10.184765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:10.186028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:10.252830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:10.268608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1402/2816] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:10.277062 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.277629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.277629 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.297238 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:10.298550 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:10.307969 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1415/2817] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:10.312809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.323606 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263bc77-6fd6-48cd-b490-37e36813dfd5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.329158 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.329843 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.330121 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.330463 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.331300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:10.331632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.333523 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.347387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1403/2818] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:10.352867 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.365378 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b159f-46ba-44b5-bc72-1faea82dcb54 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.370498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.371185 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.371468 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.371741 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.372483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.374427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.407671 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1416/2819] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:10 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:10.409039 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.419902 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb958a3-91e8-426e-9c5a-8d54add7592e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.477553 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.478227 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.478507 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.478781 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.479474 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.481430 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.503140 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1404/2820] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:10 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:10.507388 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.518715 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647966ea-3a21-4f10-8c9a-d8f13b28a248 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.524459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.525144 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.525435 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.525701 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.526436 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.528076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.538846 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1417/2821] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:10.543570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.559667 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a1029c-a6c0-4e80-b1d6-d7092b2d5c66 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.567102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.567767 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.568046 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.568353 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.569091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.570684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e3a0d-d1e6-4357-97e7-19d8e5054490 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.581702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1405/2822] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:10.586289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.600392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e15d66-5787-4d78-8047-0c906fe9b09c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.605792 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.606699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.606974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.607243 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] PATH_INFO: `/v3/projects/3d283963cf0e4109a4c5b4ebf1b160f1/users/c661f196153d43fcaa796c7f624f55df/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.622484 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d283963cf0e4109a4c5b4ebf1b160f1, user_id=c661f196153d43fcaa796c7f624f55df, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.625260 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.640935 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1418/2823] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:10 2022] PUT /identity/v3/projects/3d283963cf0e4109a4c5b4ebf1b160f1/users/c661f196153d43fcaa796c7f624f55df/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:10.651641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.652253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.652522 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.681574 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] MFA Rules not processed for user `c661f196153d43fcaa796c7f624f55df`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:10.682791 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:10.747502 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1406/2824] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:10.778387 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.780473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:10.842753 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7965aa2d-254d-478f-af3a-9b40232d1992 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.846751 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.847394 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.847672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.847934 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.859104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.861405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cd771f-a969-43fb-9558-650c2653a16d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:10.870749 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1419/2825] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:10.884998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:10.934840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:10.949624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9711b2fd-1572-4080-b890-85dec79f134a None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:10.954725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:10.955624 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:10.955900 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:10.956198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] PATH_INFO: `/v3/users/c661f196153d43fcaa796c7f624f55df` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:10.957421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] RBAC: Authorizing `identity:delete_user(user_id=c661f196153d43fcaa796c7f624f55df)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:10.959321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.012472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c661f196153d43fcaa796c7f624f55df'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.022501 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c661f196153d43fcaa796c7f624f55df'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.023165 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c661f196153d43fcaa796c7f624f55df'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.023928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c661f196153d43fcaa796c7f624f55df'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.039594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c661f196153d43fcaa796c7f624f55df'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.052290 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1407/2826] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:10 2022] DELETE /identity/v3/users/c661f196153d43fcaa796c7f624f55df => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:11.057096 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.057375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.057644 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.078841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:11.080154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:11.141210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1420/2827] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:11.151848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:11.154022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:11.214647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7107237-9449-4d40-8b57-93bce4f3bbea admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:11.219540 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:11.220220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.220563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.220866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.231998 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:11.233693 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f9a00b-db52-484c-9f91-9af26e1bc74a service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.244508 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1408/2828] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:11.510503 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:11.512264 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:11.525480 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5b0f-d81d-4216-a99d-c9a5f4c0b229 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:11.530292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:11.531142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.531420 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.531688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] PATH_INFO: `/v3/projects/3d283963cf0e4109a4c5b4ebf1b160f1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.532957 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d283963cf0e4109a4c5b4ebf1b160f1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:11.534879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.572646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:11.588901 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d283963cf0e4109a4c5b4ebf1b160f1', 'request_id': 'req-eaa21da3-2782-42d2-ab7a-a2be10763eca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.595069 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d283963cf0e4109a4c5b4ebf1b160f1', 'request_id': 'req-eaa21da3-2782-42d2-ab7a-a2be10763eca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.605330 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d283963cf0e4109a4c5b4ebf1b160f1', 'request_id': 'req-eaa21da3-2782-42d2-ab7a-a2be10763eca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.616317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] The token cache is being invalidate because project 3d283963cf0e4109a4c5b4ebf1b160f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:11.616601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.617257 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eaa21da3-2782-42d2-ab7a-a2be10763eca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:11.618902 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1421/2829] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:11 2022] DELETE /identity/v3/projects/3d283963cf0e4109a4c5b4ebf1b160f1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:11.623931 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.624319 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.624597 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.642815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:11.644030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:11.705873 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1409/2830] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:11.768278 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.768563 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.768875 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.791763 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:11.793004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:11.801401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1422/2831] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:11.805850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:11.816267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c1cb8f-6598-4a58-87e0-22f1cd0b6eb5 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:11.822171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:11.822850 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.823138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.823401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] PATH_INFO: `/v3/domains` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.824146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80363) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:11.824472 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:11.826437 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.833548 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:11.839475 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1410/2832] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:11.843889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:11.855783 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e113427-a70e-4eb5-b59f-02d5f16841d0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:11.861847 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:11.862546 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.862821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.863092 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.863788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:11.865802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.893642 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1423/2833] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:11 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:11.898587 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:11.912213 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c31f2-aa53-477f-b0c4-e5fb49da5170 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:11.970450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:11.971139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:11.971416 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:11.971689 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:11.972456 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:11.974382 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:11.996668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1411/2834] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:11 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:12.001014 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.011757 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf3023-fc85-4306-abac-e805bda972da admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.017172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.017862 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.018137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.018408 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.019172 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.020835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.031819 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1424/2835] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 07 04:16:12.035839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.046601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb060f4-816d-44be-bcee-51c8a587dbb1 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.052896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.053563 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.053848 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.054125 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.054883 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.056521 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180f40b-5caa-45e1-bb8c-ccf069ffa813 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.068212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1412/2836] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:12.074732 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.088604 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d7a7f-3910-42d4-83f7-d77409daa92b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.094745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.095585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.095858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.096164 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] PATH_INFO: `/v3/projects/c848b007c8314f3d9b10e1e51d31d9e5/users/ed21efc257194e3ba4a27547cde40f5d/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.113694 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c848b007c8314f3d9b10e1e51d31d9e5, user_id=ed21efc257194e3ba4a27547cde40f5d, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.116401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.136585 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1425/2837] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:12 2022] PUT /identity/v3/projects/c848b007c8314f3d9b10e1e51d31d9e5/users/ed21efc257194e3ba4a27547cde40f5d/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:12.149243 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.149536 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.149812 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.179109 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] MFA Rules not processed for user `ed21efc257194e3ba4a27547cde40f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:12.180400 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:12.249373 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1413/2838] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:12.254043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.318972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a0b1e-ccc5-49b3-aee2-b9c7b292b397 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.324322 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.325310 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.325595 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.325858 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.326557 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.328501 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.358081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1426/2839] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:12.363422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.375155 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4207f4-f2fe-4a89-b9e7-b3d429309b16 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.431991 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.432697 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.432979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.433257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.433940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.435887 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.445681 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:12.462415 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1414/2840] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:12.467406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.478321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e020b5-f939-46e1-9798-3e959a6c830a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.483931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.484641 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.484917 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.485182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.485904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.487516 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.498375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1427/2841] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:12.502454 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.513284 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b754a6-6357-4ebc-8176-8284721e5013 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.518577 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.519257 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.519550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.519817 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.520594 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.522171 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61698d2-3849-4bf4-b6a3-18ccd1b2dffd admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.533936 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1415/2842] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:12.538797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.555993 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ded9a2-22f3-4e77-9c6d-6edd24c2e49c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.564669 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.565573 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.565852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.566142 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] PATH_INFO: `/v3/projects/b116a983d7a04c12b7a5de146b9e7081/users/b78394675dbb44ec90a4733dc624797b/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.589270 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b116a983d7a04c12b7a5de146b9e7081, user_id=b78394675dbb44ec90a4733dc624797b, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.593404 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.609823 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1428/2843] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:12 2022] PUT /identity/v3/projects/b116a983d7a04c12b7a5de146b9e7081/users/b78394675dbb44ec90a4733dc624797b/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:12.620797 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.621093 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.621368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.649429 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] MFA Rules not processed for user `b78394675dbb44ec90a4733dc624797b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:12.650651 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:12.720620 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1416/2844] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:12.725974 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.735699 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:12.799010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221a075-f3a6-4090-9029-f41a0437ef54 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.804090 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.805989 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.806281 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.806588 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.807301 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.809362 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.839191 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1429/2845] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:12.843048 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.856424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2813b-29ed-4e03-8efb-a716da72bc78 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.923167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.923748 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.924079 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.924378 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] PATH_INFO: `/v3/users` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.925077 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.927023 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.947410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1417/2846] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:12 2022] POST /identity/v3/users => generated 295 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:12.951663 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.962150 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430b02a-b405-40a3-9a41-12992fcd2d2b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:12.967459 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:12.968136 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:12.968427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:12.968712 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:12.969450 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:12.971100 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:12.981854 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1430/2847] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:12.986108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:12.996800 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac26cc-2b2a-4e7d-99d4-74c77fb0a95a admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:13.002690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:13.003576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:13.003856 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:13.004138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] PATH_INFO: `/v3/projects/476a22776f194740bca8bd5552ae37b3/users/0ea25d1ce9cb4beca51c218a8fc0c53f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:13.019578 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a22776f194740bca8bd5552ae37b3, user_id=0ea25d1ce9cb4beca51c218a8fc0c53f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:13.022231 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:13.042322 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1418/2848] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:12 2022] PUT /identity/v3/projects/476a22776f194740bca8bd5552ae37b3/users/0ea25d1ce9cb4beca51c218a8fc0c53f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:13.047230 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:13.063912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2448a-af0e-4f77-b42d-11bd3ac6498e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:13.134683 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:13.135352 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:13.135656 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:13.135930 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:13.137252 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:13.140151 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa6e25-e9a5-4814-9572-580d4b44dbb3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:13.152182 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1431/2849] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:13.157915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:13.174882 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b9e5a-5e49-47a7-a000-a7c584f03791 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:13.180516 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:13.181442 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:13.181713 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:13.181979 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] PATH_INFO: `/v3/projects/476a22776f194740bca8bd5552ae37b3/users/0ea25d1ce9cb4beca51c218a8fc0c53f/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:13.184261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=476a22776f194740bca8bd5552ae37b3, user_id=0ea25d1ce9cb4beca51c218a8fc0c53f, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:13.186943 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:13.197942 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1419/2850] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:13 2022] PUT /identity/v3/projects/476a22776f194740bca8bd5552ae37b3/users/0ea25d1ce9cb4beca51c218a8fc0c53f/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:13.210198 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:13.210490 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:13.210760 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:13.238032 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] MFA Rules not processed for user `0ea25d1ce9cb4beca51c218a8fc0c53f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:13.239289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:13.304143 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:13.308672 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1432/2851] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:13.319390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:13.321138 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:13.352247 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:13.382412 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f26116-7cf4-4938-862a-17c327685da6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:13.386450 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:13.387108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:13.387361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:13.387630 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:13.446458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:13.447879 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:13.457641 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1420/2852] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:14.968108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:14.969780 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:14.983210 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf324d-0b91-46ac-b174-e384c8077a61 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:14.987552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:14.988240 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:14.988520 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:14.988788 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:15.051725 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:15.053213 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:15.062358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1433/2853] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:14 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:15.630310 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:15.639149 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1b18e-b239-45f3-add6-5a6e03577ce3 service cinder] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:15.643599 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:15.644255 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:15.644559 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:15.644830 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:15.654094 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:15.655524 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03ac680-81d9-4741-9324-6649ecdff3a2 service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:15.665383 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1421/2854] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:15 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:19.582009 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:19.646743 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833eff4-b923-4d92-85fc-1ea8ad43312f service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:19.652431 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:19.653316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:19.653591 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:19.653861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] PATH_INFO: `/v3/users/ed21efc257194e3ba4a27547cde40f5d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:19.655123 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed21efc257194e3ba4a27547cde40f5d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:19.657101 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:19.705645 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed21efc257194e3ba4a27547cde40f5d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:19.714317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed21efc257194e3ba4a27547cde40f5d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:19.726201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed21efc257194e3ba4a27547cde40f5d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:19.726835 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed21efc257194e3ba4a27547cde40f5d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:19.727451 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed21efc257194e3ba4a27547cde40f5d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:19.739731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1434/2855] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:19 2022] DELETE /identity/v3/users/ed21efc257194e3ba4a27547cde40f5d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:19.744628 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:19.745115 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:19.745220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:19.763285 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:19.764535 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:19.827690 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1422/2856] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:19.837990 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:19.839646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:19.861870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:19.899962 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76a6d-d309-4df5-b28a-9a4221dd156a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:19.904018 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:19.904696 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:19.904968 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:19.905234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:19.914687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:19.916266 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:19.928361 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1435/2857] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:20.210917 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:20.212691 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:20.229581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ae0f0-24a3-4b6a-950a-fd1e57d06c4e None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:20.234983 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:20.235872 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:20.236177 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:20.236448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] PATH_INFO: `/v3/projects/c848b007c8314f3d9b10e1e51d31d9e5` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:20.237774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c848b007c8314f3d9b10e1e51d31d9e5)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:20.239715 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:20.289788 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c848b007c8314f3d9b10e1e51d31d9e5', 'request_id': 'req-34992331-ec39-488d-9359-32c918c8f909'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.298215 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c848b007c8314f3d9b10e1e51d31d9e5', 'request_id': 'req-34992331-ec39-488d-9359-32c918c8f909'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.303198 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:20.304743 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c848b007c8314f3d9b10e1e51d31d9e5', 'request_id': 'req-34992331-ec39-488d-9359-32c918c8f909'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.318316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] The token cache is being invalidate because project c848b007c8314f3d9b10e1e51d31d9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:20.318601 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.319254 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.320871 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1423/2858] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:20 2022] DELETE /identity/v3/projects/c848b007c8314f3d9b10e1e51d31d9e5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:20.325564 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:20.335141 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2756c4-86f1-457d-bacd-57f3e4c7536e service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:20.393852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:20.394745 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:20.395024 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:20.395288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] PATH_INFO: `/v3/users/b78394675dbb44ec90a4733dc624797b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:20.396622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78394675dbb44ec90a4733dc624797b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:20.398813 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:20.461379 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78394675dbb44ec90a4733dc624797b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.470466 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78394675dbb44ec90a4733dc624797b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.482891 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78394675dbb44ec90a4733dc624797b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.483530 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78394675dbb44ec90a4733dc624797b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.484157 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78394675dbb44ec90a4733dc624797b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.496682 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1436/2859] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:20 2022] DELETE /identity/v3/users/b78394675dbb44ec90a4733dc624797b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:20.786498 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:20.788451 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:20.868813 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34992331-ec39-488d-9359-32c918c8f909 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:20.924978 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:20.925851 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:20.926102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:20.926376 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] PATH_INFO: `/v3/projects/b116a983d7a04c12b7a5de146b9e7081` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:20.927619 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b116a983d7a04c12b7a5de146b9e7081)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:20.929547 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:20.981776 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b116a983d7a04c12b7a5de146b9e7081', 'request_id': 'req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.990853 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b116a983d7a04c12b7a5de146b9e7081', 'request_id': 'req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:20.996662 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b116a983d7a04c12b7a5de146b9e7081', 'request_id': 'req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.007573 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] The token cache is being invalidate because project b116a983d7a04c12b7a5de146b9e7081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:21.007839 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.008513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.010123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1424/2860] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:20 2022] DELETE /identity/v3/projects/b116a983d7a04c12b7a5de146b9e7081 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:21.014220 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:21.015675 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:21.066017 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:21.074134 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47401658-ac81-433d-ba23-b2b7c46089bd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:21.131892 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:21.132802 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.133103 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.133368 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] PATH_INFO: `/v3/users/0ea25d1ce9cb4beca51c218a8fc0c53f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.134574 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ea25d1ce9cb4beca51c218a8fc0c53f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:21.136549 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:21.186174 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ea25d1ce9cb4beca51c218a8fc0c53f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.195285 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ea25d1ce9cb4beca51c218a8fc0c53f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.207886 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ea25d1ce9cb4beca51c218a8fc0c53f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.208583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ea25d1ce9cb4beca51c218a8fc0c53f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.209196 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7b9748cb-a644-4a7b-8bd1-fb623955b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ea25d1ce9cb4beca51c218a8fc0c53f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.221475 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1437/2861] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:21 2022] DELETE /identity/v3/users/0ea25d1ce9cb4beca51c218a8fc0c53f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:21.498174 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:21.499809 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:21.513436 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c95e6f-3de4-4e60-83ad-f8b60c689de3 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:21.530986 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:21.573605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:21.574483 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.574761 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.575384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] PATH_INFO: `/v3/projects/476a22776f194740bca8bd5552ae37b3` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.576765 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=476a22776f194740bca8bd5552ae37b3)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:21.578722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:21.628050 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '476a22776f194740bca8bd5552ae37b3', 'request_id': 'req-8572e330-4aeb-4c9c-b0f0-492107991860'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.636778 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '476a22776f194740bca8bd5552ae37b3', 'request_id': 'req-8572e330-4aeb-4c9c-b0f0-492107991860'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.642414 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '476a22776f194740bca8bd5552ae37b3', 'request_id': 'req-8572e330-4aeb-4c9c-b0f0-492107991860'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.653608 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] The token cache is being invalidate because project 476a22776f194740bca8bd5552ae37b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:21.653891 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.654585 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-8572e330-4aeb-4c9c-b0f0-492107991860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:21.656271 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1425/2862] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:21 2022] DELETE /identity/v3/projects/476a22776f194740bca8bd5552ae37b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:21.661415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.661713 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.661996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.708740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:21.709950 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:21.761160 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:21.774735 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1438/2863] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:21.782610 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.782899 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.783173 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.801737 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:21.802939 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:21.811758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1426/2864] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:21.816192 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:21.827023 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e554bf-30d1-482e-8316-ea655e1cdc74 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:21.832505 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:21.833186 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.833464 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.833740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.834473 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:21.834775 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:21.836474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:21.848360 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1439/2865] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:21.852684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:21.863090 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b0a50-11b8-4a8d-8975-46799a15b6e2 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:21.868671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:21.869424 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.869696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.869958 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.870668 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:21.872576 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:21.901182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1427/2866] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:21 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:21.905525 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:21.916455 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a7b2d-ded3-4546-9abd-ffda775a9375 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:21.984605 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:21.985289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:21.985567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:21.985841 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:21.986544 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:21.988526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:22.010812 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1440/2867] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:21 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:22.015308 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:22.025729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e349a93-2729-4d55-98eb-16d566975e99 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:22.030724 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:22.031381 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:22.031661 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:22.031927 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:22.032682 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:22.034316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:22.044914 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1428/2868] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:22.048927 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:22.059498 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548a99c-46e4-45e2-869b-6698d6382ee6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:22.064731 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:22.065396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:22.065678 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:22.065966 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:22.066704 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:22.068365 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3c04e-61b6-45cf-93a0-e7be4efb5638 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:22.079349 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1441/2869] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:22.083377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:22.093864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b54d5-48c5-43b9-8ba5-af73ee26bd69 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:22.098725 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:22.099612 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:22.099893 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:22.100163 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] PATH_INFO: `/v3/projects/7725196ff76e4cbb916d864ea20ad7a7/users/17675e7336884c2691a40daf93dfe972/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:22.115102 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7725196ff76e4cbb916d864ea20ad7a7, user_id=17675e7336884c2691a40daf93dfe972, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:22.117824 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:22.133581 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1429/2870] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:22 2022] PUT /identity/v3/projects/7725196ff76e4cbb916d864ea20ad7a7/users/17675e7336884c2691a40daf93dfe972/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:22.144885 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:22.145168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:22.145438 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:22.172807 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] MFA Rules not processed for user `17675e7336884c2691a40daf93dfe972`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:22.174038 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:22.243084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1442/2871] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:22.254179 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:22.255956 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:22.307720 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:22.326248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2fa8-be3e-4d89-b0ad-e774fd5f3af5 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:22.329932 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f777aaf6bb714c8c949105aa8556c0bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:22.330583 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:22.330867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:22.331142 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:22.339458 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:22.340941 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724f13-1982-498c-8069-cdc360c35eca service cinder] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:22.349784 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1430/2872] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:32.240427 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:32.268052 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:32.335122 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9e695-d84d-4872-81e3-439d7cb0c999 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:32.340439 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:32.341325 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:32.341601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:32.341965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] PATH_INFO: `/v3/users/17675e7336884c2691a40daf93dfe972` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:32.343201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17675e7336884c2691a40daf93dfe972)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:32.345177 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:32.345728 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=8 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:32.394861 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17675e7336884c2691a40daf93dfe972'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.403853 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17675e7336884c2691a40daf93dfe972'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.416053 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17675e7336884c2691a40daf93dfe972'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.416740 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17675e7336884c2691a40daf93dfe972'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.417363 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17675e7336884c2691a40daf93dfe972'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.430499 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1443/2873] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:16:32 2022] DELETE /identity/v3/users/17675e7336884c2691a40daf93dfe972 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:32.435311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:32.435595 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:32.435866 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:32.455328 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:32.456615 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:32.516590 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1431/2874] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:32.526392 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:32.527972 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:32.587051 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f77d31-7b33-4327-b54c-306a747d0cb9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:32.591596 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:32.592316 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:32.592592 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:32.592866 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:32.604067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:32.605562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36025e-a25b-4471-a649-eb403f53a2c0 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:32.615772 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1444/2875] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:32.888845 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:32.890564 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:32.905399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa2291-2950-445e-a68d-f4eabef51af3 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:32.911984 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:32.912896 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:32.913224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:32.913421 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] PATH_INFO: `/v3/projects/7725196ff76e4cbb916d864ea20ad7a7` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:32.914745 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7725196ff76e4cbb916d864ea20ad7a7)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:32.916676 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:32.966380 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7725196ff76e4cbb916d864ea20ad7a7', 'request_id': 'req-de1a6ea4-339e-4f4f-b0d7-f512e581565d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.974487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7725196ff76e4cbb916d864ea20ad7a7', 'request_id': 'req-de1a6ea4-339e-4f4f-b0d7-f512e581565d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.980144 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7725196ff76e4cbb916d864ea20ad7a7', 'request_id': 'req-de1a6ea4-339e-4f4f-b0d7-f512e581565d'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.991172 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] The token cache is being invalidate because project 7725196ff76e4cbb916d864ea20ad7a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80363) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:16:32.991452 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.992068 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-de1a6ea4-339e-4f4f-b0d7-f512e581565d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:16:32.993702 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1432/2876] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:16:32 2022] DELETE /identity/v3/projects/7725196ff76e4cbb916d864ea20ad7a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:32.998860 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:32.999145 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:32.999415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.018380 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:33.019615 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:33.037161 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:33.082818 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1445/2877] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:33.090762 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.091041 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.091311 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.111026 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:33.112387 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:33.121874 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1433/2878] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:33.126169 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.136709 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e994723-5f1c-47e4-b565-e4d7cdef9c1c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.142593 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.143324 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.143603 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.143870 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.144653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 07 04:16:33.144963 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.146931 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.159168 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1446/2879] 10.222.0.26 () {58 vars in 1152 bytes} [Thu Jul 7 04:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 07 04:16:33.163586 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.173377 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e7291-c8e5-4db5-8240-4017efe2a1ef None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.181384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.182153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.182432 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.182696 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.183395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.185354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.215013 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1434/2880] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:33 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:33.218631 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.229176 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ba068-d4d9-447a-aac8-eda65438c8c5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.288461 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.289173 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.289401 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.289668 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.290358 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.292341 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.316265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1447/2881] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:33 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:33.320513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.331433 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e96ae8-0c11-40f4-922a-04ab84ce7538 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.336575 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.337180 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.337448 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.337717 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.338453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.340099 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.353368 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1435/2882] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:33.358994 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.370882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7341e356-c5eb-4253-ba40-5c71a7ed4f4e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.376620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.377288 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.377567 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.377832 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.378566 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.380234 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b0300-cfe7-4fcf-9e94-35812a98aab0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.391914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1448/2883] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:33.396354 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.406584 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f3c73-dc33-4d5a-bfbd-010791dbdaf6 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.412714 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.413617 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.413894 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.414166 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] PATH_INFO: `/v3/projects/b62058cd25e5421fbc57cf58022f5ccf/users/6f2ad423eac349fb9469582d6aa1ec5b/roles/53143fe8892742cda2ef02e845ce54f2` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.430988 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b62058cd25e5421fbc57cf58022f5ccf, user_id=6f2ad423eac349fb9469582d6aa1ec5b, role_id=53143fe8892742cda2ef02e845ce54f2)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.433711 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.448940 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1436/2884] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:33 2022] PUT /identity/v3/projects/b62058cd25e5421fbc57cf58022f5ccf/users/6f2ad423eac349fb9469582d6aa1ec5b/roles/53143fe8892742cda2ef02e845ce54f2 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:33.454482 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4055-8a3c-4cee-a7ac-ab2398e0f414 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.454797 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4055-8a3c-4cee-a7ac-ab2398e0f414 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.455073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c4055-8a3c-4cee-a7ac-ab2398e0f414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.474856 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a94c4055-8a3c-4cee-a7ac-ab2398e0f414 None None] MFA Rules not processed for user `d1bd7595a3f7469e9385fd3e6286b86e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:33.476073 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a94c4055-8a3c-4cee-a7ac-ab2398e0f414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:33.538375 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1449/2885] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:33.548222 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:33.550253 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:33.574632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:33.614159 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a88f5e-7ed2-4d46-bc3d-2d26115d4020 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:33.618167 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:33.618815 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:33.619087 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:33.619356 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:33.629734 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:33.631193 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:33.641261 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1437/2886] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:37.625879 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:37.626423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:37.626423 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:37.655996 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] MFA Rules not processed for user `6f2ad423eac349fb9469582d6aa1ec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:37.657318 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:37.676620 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:37.737428 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1450/2887] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:37.742073 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:37.753136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82654c04-902f-44a2-8ea1-4816bff6f111 service neutron] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:37.760410 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:37.761124 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:37.761399 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:37.761671 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:37.762390 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:37.764355 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:37.793126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1438/2888] 10.222.0.26 () {60 vars in 1152 bytes} [Thu Jul 7 04:16:37 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:37.797292 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:37.809130 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32703cd-86d4-4f4b-b8e8-e22da3ea6e54 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:37.868527 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:37.869217 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:37.869497 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:37.869773 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:37.870486 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:37.872889 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:37.895289 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1451/2889] 10.222.0.26 () {60 vars in 1143 bytes} [Thu Jul 7 04:16:37 2022] POST /identity/v3/users => generated 298 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 07 04:16:37.899393 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:37.911061 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc4ef1-8610-4830-90ef-68650cd45a28 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:37.916064 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:37.916808 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:37.917108 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:37.917361 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:37.918116 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:37.919751 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:37.932329 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1439/2890] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:37.936778 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:37.947761 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7befb8cb-fe18-4d5b-80ea-89da086f6284 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:37.953294 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:37.954253 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:37.954535 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:37.954786 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] PATH_INFO: `/v3/projects/75c958eb4e684693ad606bff8ef6a304/users/94d513c5ab2e4429ab39f0fb35c7718c/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:37.971940 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c958eb4e684693ad606bff8ef6a304, user_id=94d513c5ab2e4429ab39f0fb35c7718c, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:37.974579 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:37.990154 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1452/2891] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:37 2022] PUT /identity/v3/projects/75c958eb4e684693ad606bff8ef6a304/users/94d513c5ab2e4429ab39f0fb35c7718c/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:16:37.993971 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:38.004698 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72683d95-9460-4ca7-a429-0d51654a2e08 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:38.065001 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:38.065801 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:38.066178 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:38.066557 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:38.067351 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:38.069192 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb9e30-63e1-4e3b-bfec-9e340a82d946 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:38.081263 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1440/2892] 10.222.0.26 () {58 vars in 1121 bytes} [Thu Jul 7 04:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 07 04:16:38.085601 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:38.096104 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1d04e-75a7-4db0-8d07-7fe51568177a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:38.101121 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:38.102040 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:38.102314 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:38.102583 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] PATH_INFO: `/v3/projects/75c958eb4e684693ad606bff8ef6a304/users/94d513c5ab2e4429ab39f0fb35c7718c/roles/934fc30b07224e74a7e92e71e67aa4e9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:38.104759 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c958eb4e684693ad606bff8ef6a304, user_id=94d513c5ab2e4429ab39f0fb35c7718c, role_id=934fc30b07224e74a7e92e71e67aa4e9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:38.107403 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:38.118952 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1453/2893] 10.222.0.26 () {60 vars in 1482 bytes} [Thu Jul 7 04:16:38 2022] PUT /identity/v3/projects/75c958eb4e684693ad606bff8ef6a304/users/94d513c5ab2e4429ab39f0fb35c7718c/roles/934fc30b07224e74a7e92e71e67aa4e9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:16:42.370511 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ef2b-a4b1-42d5-9aee-7e43b4944956 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:42.371091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ef2b-a4b1-42d5-9aee-7e43b4944956 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:42.371091 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739ef2b-a4b1-42d5-9aee-7e43b4944956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:42.413221 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-7739ef2b-a4b1-42d5-9aee-7e43b4944956 None None] MFA Rules not processed for user `94d513c5ab2e4429ab39f0fb35c7718c`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:42.415465 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-7739ef2b-a4b1-42d5-9aee-7e43b4944956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:42.510402 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1441/2894] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:42.523437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:42.525317 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:42.616343 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132ea85-ee7e-4cdc-b9de-d72bfd0c6950 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:42.621646 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '068cf00a56cc488586b207a13592f6e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:42.623133 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:42.623474 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:42.623874 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:42.644415 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:42.698084 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:42.699577 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:42.710137 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1454/2895] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:42.820394 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d571-67f2-4481-b354-2ded6ebd4852 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:42.820758 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d571-67f2-4481-b354-2ded6ebd4852 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:42.821136 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730d571-67f2-4481-b354-2ded6ebd4852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:42.842868 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-8730d571-67f2-4481-b354-2ded6ebd4852 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:42.844101 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-8730d571-67f2-4481-b354-2ded6ebd4852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:42.850443 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:16:42.903666 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1442/2896] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:16:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:42.926279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:42.928076 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:42.999124 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca9107-ef55-4a1e-9b36-9bcdc0a44832 service glance] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:43.004025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:43.004800 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:43.005072 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:43.005339 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:43.013231 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:43.014820 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:43.023290 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1455/2897] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:16:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:16:51.451852 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006a5-dc39-4cad-897a-f3fbcf253319 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:51.452478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006a5-dc39-4cad-897a-f3fbcf253319 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:51.452478 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28006a5-dc39-4cad-897a-f3fbcf253319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:51.471935 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-e28006a5-dc39-4cad-897a-f3fbcf253319 None None] MFA Rules not processed for user `6f2ad423eac349fb9469582d6aa1ec5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:51.473168 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-e28006a5-dc39-4cad-897a-f3fbcf253319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:51.481095 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1443/2898] 10.222.0.26 () {58 vars in 957 bytes} [Thu Jul 7 04:16:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:52.069452 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:52.070922 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:52.143938 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6e592-f1a9-4caa-88b3-7cb7bfe41491 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:52.149043 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:52.149688 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:52.149965 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:52.150236 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:52.152010 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:52.163321 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:52.164955 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:52.174821 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1456/2899] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:16:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:16:53.460384 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:53.460867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:53.460867 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:53.479300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:16:53.480550 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:16:53.494684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1444/2900] 10.222.0.26 () {58 vars in 1009 bytes} [Thu Jul 7 04:16:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:16:53.507299 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:16:53.519012 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085a6d3-0d5a-41b1-bd99-ea249789121a service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:16:53.525915 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:16:53.526622 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:16:53.526900 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:16:53.527303 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:16:53.536914 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:16:53.538687 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:16:53.549594 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1457/2901] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:16:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:17:03.489009 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=29 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:17:03.545710 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:17:11.809680 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:17:11.811386 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:17:11.900510 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4748b-3017-4692-ae60-33c3e433e26c None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:17:11.906209 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bd030577928438b940c477cb4fc2456', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:17:11.906864 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:17:11.907146 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:17:11.907422 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:17:11.909299 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:17:11.922123 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:17:11.923721 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:17:11.935267 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1445/2902] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:17:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:17:19.242882 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:17:19.309384 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da22a98-3e2f-4729-b5cb-3b78ab78563b service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:17:19.313912 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:17:19.314562 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:17:19.314838 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:17:19.315111 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:17:19.325526 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:17:19.326971 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:17:19.337003 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1458/2903] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:17:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:17:21.932426 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=38 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:17:29.332560 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=30 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:18:03.567647 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:18:03.569300 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:18:03.609755 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2425b3-28a9-4a9c-aefe-00708e14a2af service nova] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:18:03.616017 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:18:03.616766 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:18:03.617043 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:18:03.617321 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:18:03.619316 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:18:03.631236 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:18:03.632857 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:18:03.643015 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1446/2904] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:18:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:18:13.638837 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=15 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:39.075108 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:39.088419 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8580b3-4c77-4b5f-bd2a-e020dba1ed8f service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:39.092658 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:39.093315 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:39.093590 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:39.093857 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:39.095695 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:39.125929 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:39.127417 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:39.138869 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1459/2905] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:19:39.715401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:39.727028 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ef5173-f793-4638-b00b-eaa40b7d1419 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:39.731532 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:39.732248 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:39.732722 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:39.733160 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:39.735487 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:39.770738 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:39.772397 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ba0c0-9f2f-4cef-aecf-cae6fa173f62 service neutron] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:39.798224 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1447/2906] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:19:44.915908 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:44.925312 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8d86c-e269-4730-87a5-e4c39a83e05a service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:44.930004 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '21ad18656f0a472783d122a1380d4905', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:44.930626 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:44.930942 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:44.931163 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:44.934405 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:44.950346 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:44.951852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:44.963597 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1460/2907] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:19:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:19:47.450484 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] REQUEST_METHOD: `POST` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:47.450915 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:47.451022 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:47.509306 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.auth.core [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] MFA Rules not processed for user `97f96a1dea234550944a94d3eaac4aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80363) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 07 04:19:47.510566 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:47.527816 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1448/2908] 10.222.0.26 () {58 vars in 967 bytes} [Thu Jul 7 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 07 04:19:47.568287 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:47.590648 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73a4c59-3de2-46b5-9181-b9c711d038d9 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:47.596265 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48a2ed589c5742d3acd30e59e9f1da2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:47.596909 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:47.597188 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:47.597454 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:47.605653 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:47.607350 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:47.615279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1461/2909] 10.222.0.26 () {60 vars in 1384 bytes} [Thu Jul 7 04:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 07 04:19:50.845190 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:50.859059 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87807d01-1495-4a86-84fd-0cf6bb65dd09 None None] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:50.869747 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:50.870453 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:50.870729 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:50.871000 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:50.873085 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:50.889686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:50.891634 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:50.903774 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1449/2910] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:19:54.142406 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:54.154437 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bda4e-118d-41cf-9491-5158bd784d11 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:54.159430 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:54.160201 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:54.160483 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:54.160756 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:54.162532 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:54.176703 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:54.179087 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:54.191755 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1462/2911] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:19:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:19:54.209126 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:54.284968 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f19df-a2d3-4798-bbd5-cbd50e8871d4 service placement] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:54.289513 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:54.290401 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:54.290741 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:54.291034 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] PATH_INFO: `/v3/users/6f2ad423eac349fb9469582d6aa1ec5b` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:54.292278 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2ad423eac349fb9469582d6aa1ec5b)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:54.294238 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:54.342303 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2ad423eac349fb9469582d6aa1ec5b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.350395 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2ad423eac349fb9469582d6aa1ec5b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.351036 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2ad423eac349fb9469582d6aa1ec5b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.351632 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2ad423eac349fb9469582d6aa1ec5b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.364684 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2ad423eac349fb9469582d6aa1ec5b'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.369605 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:54.379993 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1450/2912] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:19:54 2022] DELETE /identity/v3/users/6f2ad423eac349fb9469582d6aa1ec5b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:19:54.561245 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:54.574785 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5242d-9048-4514-9b20-9e52e6972083 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:54.632099 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:54.633028 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:54.633391 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:54.633680 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] PATH_INFO: `/v3/projects/b62058cd25e5421fbc57cf58022f5ccf` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:54.634852 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b62058cd25e5421fbc57cf58022f5ccf)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:54.636793 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:54.684552 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b62058cd25e5421fbc57cf58022f5ccf', 'request_id': 'req-77498a28-e71a-40de-b302-582ebe3b177b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.690953 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b62058cd25e5421fbc57cf58022f5ccf', 'request_id': 'req-77498a28-e71a-40de-b302-582ebe3b177b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.700538 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b62058cd25e5421fbc57cf58022f5ccf', 'request_id': 'req-77498a28-e71a-40de-b302-582ebe3b177b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.710991 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] The token cache is being invalidate because project b62058cd25e5421fbc57cf58022f5ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:19:54.711279 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.711988 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.713851 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1463/2913] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:19:54 2022] DELETE /identity/v3/projects/b62058cd25e5421fbc57cf58022f5ccf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 07 04:19:54.718182 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:54.719639 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:54.734030 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ff35a-203a-435a-b35a-999dbb9fa0f7 admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:54.793408 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:54.794289 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:54.794570 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:54.794840 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] PATH_INFO: `/v3/users/94d513c5ab2e4429ab39f0fb35c7718c` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:54.796111 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d513c5ab2e4429ab39f0fb35c7718c)` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:54.798074 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:54.858139 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d513c5ab2e4429ab39f0fb35c7718c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.869334 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d513c5ab2e4429ab39f0fb35c7718c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.870035 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d513c5ab2e4429ab39f0fb35c7718c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.870803 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d513c5ab2e4429ab39f0fb35c7718c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.882735 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.notifications [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d513c5ab2e4429ab39f0fb35c7718c'} {{(pid=80363) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:54.894928 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1451/2914] 10.222.0.26 () {58 vars in 1223 bytes} [Thu Jul 7 04:19:54 2022] DELETE /identity/v3/users/94d513c5ab2e4429ab39f0fb35c7718c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:19:55.071904 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:19:55.073782 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:19:55.086534 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498a28-e71a-40de-b302-582ebe3b177b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:19:55.100569 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:19:55.149113 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1bd7595a3f7469e9385fd3e6286b86e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43ba045a853249cf8b4e900b21790d5d', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:19:55.150110 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:19:55.150396 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:19:55.150664 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] PATH_INFO: `/v3/projects/75c958eb4e684693ad606bff8ef6a304` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:19:55.152041 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c958eb4e684693ad606bff8ef6a304)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:19:55.154025 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:19:55.204081 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c958eb4e684693ad606bff8ef6a304', 'request_id': 'req-0470d5a6-9652-4d02-ba55-f828857906f5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:55.210660 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c958eb4e684693ad606bff8ef6a304', 'request_id': 'req-0470d5a6-9652-4d02-ba55-f828857906f5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:55.220256 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c958eb4e684693ad606bff8ef6a304', 'request_id': 'req-0470d5a6-9652-4d02-ba55-f828857906f5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:55.230633 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] The token cache is being invalidate because project 75c958eb4e684693ad606bff8ef6a304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 07 04:19:55.230918 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:55.231528 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0470d5a6-9652-4d02-ba55-f828857906f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 07 04:19:55.233149 dv-cinder-846842-11-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1464/2915] 10.222.0.26 () {58 vars in 1232 bytes} [Thu Jul 7 04:19:55 2022] DELETE /identity/v3/projects/75c958eb4e684693ad606bff8ef6a304 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 07 04:20:04.891686 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:20:05.228067 dv-cinder-846842-11-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 07 04:23:10.539369 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Authenticating user token {{(pid=80363) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 07 04:23:10.541019 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:23:10.613153 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05847b-4df5-4b3f-8b46-b56a93af813e admin admin] Validating token access rules against request {{(pid=80363) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 07 04:23:10.683964 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc67945c16854249b102555f7864d148', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4b336389d1e459695fa2a0453a08c93', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80363) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 07 04:23:10.684672 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] REQUEST_METHOD: `GET` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 07 04:23:10.684948 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] SCRIPT_NAME: `/identity` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 07 04:23:10.685220 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80363) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 07 04:23:10.687088 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.fernet_utils [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80363) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 07 04:23:10.699212 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 07 04:23:10.700910 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe6a81-fc23-458f-9577-c455e9db6521 service placement] RBAC: Authorization granted {{(pid=80363) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 07 04:23:10.710974 dv-cinder-846842-11-smb devstack@keystone.service[80363]: [pid: 80363|app: 0|req: 1452/2916] 10.222.0.26 () {60 vars in 1365 bytes} [Thu Jul 7 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 07 04:23:20.706918 dv-cinder-846842-11-smb devstack@keystone.service[80363]: DEBUG dbcounter [-] [80363] Writing DB stats keystone:SELECT=58 {{(pid=80363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}